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Preface 


This book provides an introduction to the theory of dynamical systems with the 
aid of Python. It is written for both senior undergraduates and graduate students. 
Chapter 1 provides a tutorial introduction to Python—new users should go 
through this chapter carefully while those moderately familiar and experienced 
users will find this chapter a useful source of reference. The first part of the book 
deals with continuous systems using differential equations, including both 
ordinary and delay differential equations (Chapters 2 — 12 ), the second part is 
devoted to the study of discrete systems (Chapters 13 — 17 ), and Chapters 18 — 
21 deal with both continuous and discrete systems. Chapter 22 gives examples 
of coursework and also lists three Python-based examinations to be sat in a 
computer laboratory with access to Python. Chapter 23 lists answers to all of the 
exercises given in the book. It should be pointed out that dynamical systems 
theory is not limited to these topics but also encompasses partial differential 
equations, integral and integro-differential equations, and stochastic systems, for 
instance. References [1—6] given at the end of the Preface provide more 
information for the interested reader. The author has gone for breadth of 
coverage rather than fine detail and theorems with proofs are kept at a minimum. 
The material is not clouded by functional analytic and group theoretical 
definitions, and so is intelligible to readers with a general mathematical 
background. Some of the topics covered are scarcely covered elsewhere. Most of 
the material in Chapters 9 — 12 and 16-21 is at postgraduate level and has been 
influenced by the author’s own research interests. There is more theory in these 
chapters than in the rest of the book since it is not easily accessed anywhere else. 
It has been found that these chapters are especially useful as reference material 
for senior undergraduate project work. The theory in other chapters of the book 
is dealt with more comprehensively in other texts, some of which may be found 
in the references section of the corresponding chapter. The book has a very 
hands-on approach and takes the reader from the basic theory right through to 
recently published research material. 

Python is extremely popular with a wide range of researchers from all sorts 
of disciplines; it has a very user-friendly interface and has extensive 
visualization and numerical computation capabilities. It is an ideal package to 
adopt for the study of nonlinear dynamical systems; the numerical algorithms 
work very quickly, and complex pictures can be plotted within seconds. 

The first chapter provides an efficient tutorial introduction to Python. Simple 
Python programming is introduced using three basic programming structures: 


defining functions, for loops, and if, then, else constructs. New users will find 
the tutorials will enable them to become familiar with Python within a few days. 
Both engineering and mathematics students appreciate this method of teaching 
and I have found that it generally works well with one staff member to about 
twenty students in a computer laboratory. In most cases, I have chosen to list the 
Python commands at the end of each chapter; this avoids unnecessary cluttering 
in the text. The Python programs have been kept as simple as possible and 
should run under later versions of the package. All Python files for the book 
(including updates and extra files) can even be downloaded from the Web via 
GitHub at: https://github.com/springer-math/dynamical-systems-with- 
applications-using-python 

Readers will find that they can reproduce the figures given in the text, and 
then it is not too difficult to change parameters or equations to investigate other 
systems. 

Chapters 2 — 12 deal with continuous dynamical systems. Chapters 2 and 3 
cover some theory of ordinary differential equations and applications to models 
in the real world are given. The theory of differential equations applied to 
chemical kinetics and electric circuits is introduced in some detail. The 
memnistor is introduced and one of the most remarkable stories in the history of 
mathematics is relayed. Chapter 2 ends with the existence and uniqueness 
theorem for the solutions of certain types of differential equations. The theory 
behind the construction of phase plane portraits for two-dimensional systems is 
dealt with in Chapter 3 Applications are taken from chemical kinetics, 
economics, electronics, epidemiology, mechanics, and population dynamics. The 
modeling of the populations of interacting species is discussed in some detail in 
Chapter 4 and domains of stability are discussed for the first time. Limit cycles, 
or isolated periodic solutions, are introduced in Chapter 5 Since we live ina 
periodic world, these are the most common type of solution found when 
modeling nonlinear dynamical systems. They appear extensively when modeling 
both the technological and natural sciences. Hamiltonian, or conservative, 
systems and stability are discussed in Chapter 6 , and Chapter 7 is concerned 
with how planar systems vary depending upon a parameter. Bifurcation, 
bistability, multistability, and normal forms are discussed. 

The reader is first introduced to the concept of chaos in continuous systems 
in Chapters 8 and 9 , where three-dimensional systems and Poincaré maps are 
investigated. These higher-dimensional systems can exhibit strange attractors 
and chaotic dynamics. One can rotate the three-dimensional objects in Python 
and plot time series plots to get a better understanding of the dynamics involved. 
Once again, the theory can be applied to chemical kinetics (including stiff 


systems), electric circuits, and epidemiology; a simplified model for the weather 
is also briefly discussed. Chapter 9 deals with Poincaré first return maps that 
can be used to untangle complicated interlacing trajectories in higher- 
dimensional spaces. A periodically driven nonlinear pendulum is also 
investigated by means of a nonautonomous differential equation. Both local and 
global bifurcations are investigated in Chapter 10 . The main results and 
statement of the famous second part of David Hilbert’s sixteenth problem are 
listed in Chapter 11 . In order to understand these results, Poincaré 
compactification is introduced. The study of continuous systems ends with one 
of the authors specialities—limit cycles of Liénard systems. There is some detail 
on Liénard systems, in particular, in this part of the book, but they do have a 
ubiquity for systems in the plane. Chapter 12 provides an introduction to delay 
differential equations with applications in biology and nonlinear optics. 

Chapters 13 — 17 deal with discrete dynamical systems. Chapter 13 starts 
with a general introduction to iteration and linear recurrence (or difference) 
equations. The bulk of the chapter is concerned with the Leslie model used to 
investigate the population of a single species split into different age classes. 
Harvesting and culling policies are then investigated and optimal solutions are 
sought. Nonlinear discrete dynamical systems are dealt with in Chapter 14. 
Bifurcation diagrams, chaos, intermittency, Lyapunov exponents, periodicity, 
quasiperiodicity, and universality are some of the topics introduced. The theory 
is then applied to real-world problems from a broad range of disciplines 
including population dynamics, biology, economics, nonlinear optics, and neural 
networks. Chapter 15 is concerned with complex iterative maps in the Argand 
plane, where Julia sets and the now-famous Mandelbrot set are plotted. Basins of 
attraction are investigated for these complex systems and Newton fractals are 
introduced. As a simple introduction to optics, electromagnetic waves and 
Maxwell’s equations are studied at the beginning of Chapter 16 . Complex 
iterative equations are used to model the propagation of light waves through 
nonlinear optical fibers. A brief history of nonlinear bistable optical resonators is 
discussed and the simple fiber ring resonator is analyzed in particular. Chapter 
16 is devoted to the study of these optical resonators, and there is discussion on 
phenomena such as bistability, chaotic attractors, feedback, hysteresis, 
instability, linear stability analysis, multistability, nonlinearity, and steady states. 
The first and second iterative methods are defined in this chapter. Some simple 
fractals may be constructed using pencil and paper in Chapter 17 , and the 
concept of fractal dimension is introduced. Fractals may be thought of as 
identical motifs repeated on ever-reduced scales. Unfortunately, most of the 
fractals appearing in nature are not homogeneous but are more heterogeneous, 


hence the need for the multifractal theory given later in the chapter. It has been 
found that the distribution of stars and galaxies in our universe is multifractal, 
and there is even evidence of multifractals in rainfall, stock markets, and 
heartbeat rhythms. Applications in geoscience, materials science, microbiology, 
and image processing are briefly discussed. Chapter 18 provides a brief 
introduction to image processing which is being used more and more by a 
diverse range of scientific disciplines, especially medical imaging. The fast 
Fourier transform is introduced and has a wide range of applications throughout 
the realms of science. 

Chapter 19 is devoted to the new and exciting theory behind chaos control 
and synchronization. For most systems, the maxim used by engineers in the past 
has been “stability good, chaos bad,” but more and more nowadays this is being 
replaced with “stability good, chaos better.” There are exciting and novel 
applications in cardiology, communications, engineering, laser technology, and 
space research, for example. A brief introduction to the enticing field of neural 
networks is presented in Chapter 20 . Imagine trying to make a computer mimic 
the human brain. One could ask the question: In the future will it be possible for 
computers to think and even be conscious? The human brain will always be 
more powerful than traditional, sequential, logic-based digital computers and 
scientists are trying to incorporate some features of the brain into modern 
computing. Neural networks perform through learning and no underlying 
equations are required. Mathematicians and computer scientists are attempting to 
mimic the way neurons work together via synapses; indeed, a neural network 
can be thought of as a crude multidimensional model of the human brain. The 
expectations are high for future applications in a broad range of disciplines. 
Neural networks are already being used in machine learning and pattern 
recognition (computer vision, credit card fraud, prediction and forecasting, 
disease recognition, facial and speech recognition), the consumer home 
entertainment market, psychological profiling, predicting wave over-topping 
events, and control problems, for example. They also provide a parallel 
architecture allowing for very fast computational and response times. In recent 
years, the disciplines of neural networks and nonlinear dynamics have 
increasingly coalesced and a new branch of science called neurodynamics is 
emerging. Lyapunov functions can be used to determine the stability of certain 
types of neural network. There is also evidence of chaos, feedback, nonlinearity, 
periodicity, and chaos synchronization in the brain. 

Chapter 21 focuses on binary oscillator computing, the subject of UK, 
International, and Taiwanese patents. The author and his co-inventor, Jon 
Borresen, came up with the idea when modeling connected biological neurons. 


Binary oscillator technology can be applied to the design of arithmetic logic 
units (ALUs), memory, and other basic computing components. It has the 
potential to provide revolutionary computational speed-up, energy saving, and 
novel applications and may be applicable to a variety of technological paradigms 
including biological neurons, complementary metal-oxide-semiconductor 
(CMOS), memristors, optical oscillators, and superconducting materials. The 
research has the potential for MMU and industrial partners to develop super fast, 
low-power computers and may provide an assay for neuronal degradation for 
brain malfunctions such as Alzheimer’s, epilepsy, and Parkinson’s disease! 
Examples of coursework and three examination-type papers are listed in 
Chapter 22 , and a complete set of solutions for the book is listed in Chapter 23 


Both textbooks and research papers are presented in the list of references. 
The textbooks can be used to gain more background material, and the research 
papers have been given to encourage further reading and independent study. 

This book is informed by the research interests of the author, which are 
currently nonlinear ordinary differential equations, nonlinear optics, 
multifractals, neural networks, and binary oscillator computing. Some references 
include recently published research articles by the author along with two patents. 

The prerequisites for studying dynamical systems using this book are 
undergraduate courses in linear algebra, real and complex analysis, calculus, and 
ordinary differential equations; a knowledge of a computer language such as 
Basic, C, or Fortran would be beneficial but not essential. 
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1. A Tutorial Introduction to Python 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


To introduce simple programming in Python. 

To provide tutorial guides to modules in Python. 

To promote self-help using the online help facilities. 

To provide a concise source of reference for experienced users. 


On completion of this chapter, the reader should be able to 


e download and use IDLE to write simple Python programs; 

e download the open data science platform Anaconda and use Spyder (Scientific 
PYthon Development EnviRonment) to run more advanced Python programs; 

e access Python program files over the World Wide Web. 


It is assumed that the reader is familiar with at least one of either the 
Windows , Mac Operating System (OS) , or UNIX platforms. This book was 
prepared using Python version 3.7 on a Mac OS but most programs should work 
under earlier and later versions of Python 3. Note that the programs will not be 
compatible with Python 2, and that Python 2 is due for end-of-life in 2020. Note 
that the online version of the Python programs for this book will be written using 
the most up to date version of the package. Python programs can be downloaded 
from GitHub at: 

https://github.com/springer-math/dynamical-systems-with-applications- 
using-python 

Readers should note that this is not a chapter dedicated to programming but 
is intended to provide a concise introduction to Python in order to tackle 
problems outlined later in the book. The programs and commands listed in this 
chapter have been chosen to allow the reader to become familiar with Python 
within a few days. They provide a concise summary of the type of commands 


that will be used throughout the text. New users should be able to start on their 
own problems after completing the chapter, and experienced users should find 
this chapter an excellent source of reference. Of course, there are many Python 
textbooks on the market for those who require further applications or more 
detail. For a more in-depth introduction to programming with Python, the reader 
is directed to the texts [1, 2, 6, 12, 13], and [15], for mathematical applications 
the reader should consult [3, 4, 5], and [10], and for an introduction to 
programming with the Raspberry Pi, please see [11]. 

As with other chapters in the book, the reader is encouraged to learn 
programming by example thus avoiding many hours of decoding. The reader 
should run the example programs and then seek syntax and explanations on 
program structure either from the Python help pages on the web or in books such 
as those referred to in the reference section. 


1.1 The IDLE Integrated Development Environment 
for Python 


Python was developed by Guido van Rossum and first released in 1991. It isa 
high-level programming language and supports functional, imperative, object- 
oriented, and procedural styles of programming. The official home of the Python 
programming language is: 


and part of the homepage is illustrated in Figure 1.1. 


Python 


@ python” > E | 


ee P m 


Downloads Documentation Community Success Stories News Events 


About 


The core of extensible programming is defining functions. 
Python allows mandatory and optional arguments, keyword 


arguments, and even arbitrary argument lists 


Python is a programming language that lets you work quickly 
and integrate systems more effectively. ) 


Figure 1.1 Part of the official Python programming language homepage. 


@ IDLE File Edit Shell Debug Options Window Help 


© © © Python 3.7.0 Shell 
Python 3.7.0 (v3.7.0:1bf9cc5093, Jun 26 2018, 23:26:24) 
[Clang 6.0 Cclang-600.0.57)] on darwin 


Type "copyright", "credits" or "license()" for more information. 
>>> 


Lm 1 Coko 


Figure 1.2 The IDLE Editor window as it first appears when opened on a Macbook. The chevron prompt 
>>> signals that Python is waiting for input. 


Click on the Download tab to install Python on to your computer if it is not 
already there. Once you have downloaded the latest version of Python you will 
need to access IDLE, which is bundled with Python and is Python’s integrated 
development and learning environment which works on Windows, Mac OS, and 
Unix platforms. Readers can use either a shell window or an Editor window; the 
author has used an Editor window in this chapter, as illustrated in Figure 1.2. 

The following commands show how Python can be used as a powerful 
calculator within IDLE. 


1.1.1 Tutorial One: Using Python as a Powerful Calculator 

Copy the commands after the chevron prompt >>> in the IDLE Editor window 
(see Figure 1.2). There is no need to copy the comments, they are there to help 
you. The output is not displayed. New users should type the commands line by 
line while experienced users can use the tutorial for reference. For help on the 
math module type >>>import math, then >>>help(math), in the Python Editor 
Window (Python Shell). 


>>> # This is a comment. # Helps when writing programs. 


>>> 2**0,5 
>>> x**2 + 1 


>>> type(x) 
>>> type(x1) 
>> ant 
> roundo, 2) 
>>> # Complex Numbers. Po 
>>> type(z1) 
= abe 
> ar conguaated 
>>> a=[1, 2, 3, 4, 5] 
>>> type(a) 
>>> a[0] # 4st element, © based 
>>> a[-1] # The last element. 
=> Jena 
= mina 
= wana 
>>> 2* a # [4,2,3,4,5,1,2,3,4,5]. 
> aappenal@ 

# Removes the first 6 found. | 


>>> a.remove(6) # Removes the first 6 found. 


>>> print(a) # Prints the list 
>>> a[1 : 3] # Slice to get the list [2,3]. 


>>> range(10) # A range object zero to nine. 


S55 List (range(S) 
>>> List (range(4, 9) 
>>> list (range(2, 10, 2)) 
>>> list(range(10, 5, -2))|# A list [10,8,6]. | 
= 
>>> A[O][1] 
>>> from math import sin 
=> sinpi) 
SF acos (0) 
= exp (0:2) 
5> 109100.3) 
==> floor (2.35) 


1.1.2 Tutorial Two: Simple Programming with Python 

Tutorial One demonstrated how one may use the IDLE Editor window as a 
powerful calculator using Python commands. In this subsection, the reader will 
be shown how to construct simple Python programs. In the IDLE Editor 
window, click on the File tab and then New File. An Untitled window opens and 
the reader types in Python command lines as illustrated in Figure 1.3. 

In this section, the author has decided to concentrate on three programming 
structures: (i) defining functions, (ii) using for and while loops, and (iii) if, elif, 
else constructs. These three structures are commonly taught to new programmers 
and readers will see that they are used extensively in this book. 


é IDLE File Edit Format Run Options Window Help 


@ @ ® f _mu.py - /Users/sladmin/Documents/Python Programs/f_mu.py (3.7.0) 


Ht The logistic function - save file as f_mu.py. 
# Run the Module (or type F5). 


You can write your own text here. 
Created on Thur May 24 09:23:47 2018 
@author: sladmin 


def f_muCmu, x): 
return mu * x * (1 - x) 


Ln: 1 Coko 


Figure 1.3 File Editor window displaying a Python program defining the logistic function. 


(i) Defining Functions. Examples 1 and 2 illustrate how functions are 
defined in Python. 


Example 1. Write a Python program that defines the logistic function given by 
f ,(X) = px(1 — x). Once defined and executed, the function gives an extra 


command within IDLE. 


Solution. The first program is shown in Figure 1.3 and defines the logistic 
function saved as f_mu. py. All Python programs should be saved with.py at 
the end of the filename. Note that comments appear as red text, and non- 
executable author text can be inserted between the triple quotes (green text). The 
def command defines the function, which in this case is a function of two 
variables, p and x. At the end of the def line one types a colon and then IDLE 
automatically indents the next line after you type the ENTER key. In the final line 
one types return followed by your choice of function. The program then returns 
that function. 

To run the program, click on Run and Run Module or click the F5 function 
button. You will see that the program has executed in the IDLE Editor window. 
One can then call this function in the IDLE Editor window as shown below. The 
output has also been included. 

>>> f_mu(2, 0.8) 

0.31999999999999995 

Thus, Python calculates f (0. 8) as 0. 31999999999999995, this is as a result 


of floating point arithmetic. 


Example 2. Write a Python Program that converts degrees Fahrenheit in to 
Kelvin. 


@ IDLE File Edit Format Run Options Window Help 


@ ®© @ F2K.py - /Users/sladmin/Documents/Python Programs/F2K.py (3.7.0) 


k A function to convert degrees Fahrenheit to Kelvin. 

# Save file as F2K.py. 

# Run the Module (Cor type F5). 

def F2KQ): 
F = intCinputC'Enter temperature in degrees Fahrenheit: ')) 
K = CF + 459.67) * 5/9 
printC'Temperature in Kelvin is {} K'.formatCK)) 


Laz Coko 


Figure 1.4 File Editor window showing a Python program for converting degrees Fahrenheit into Kelvin, 
saved as F2K.py. 


Solution. The Python program to convert Fahrenheit to Kelvin is shown in 
Figure 1.4 and the IDLE command line and output is listed below. Run the 
module before entering the IDLE command line. 

>>> F2K() 

Enter temperature in degrees Fahrenheit: 68 

Temperature in Kelvin is: 293.15000000000003 K 

(ii) Using Loops. Examples 3 and 4 illustrate how for and while loops can be 
used for repetitive tasks. 


Example 3. Use the for statement to write a Python Program that lists the first n 
terms of the Fibonacci sequence. 


Solution. The Python program for listing the first n terms of the Fibonacci 
sequence is shown in Figure 1.5 and the IDLE command line and output is listed 
below. Run the module before entering the IDLE command line. 


@ IDLE File Edit Format Run Options Window Help 


@ @ @ fibonacci.py - /Users/sladmin/Documents/Python Programs/fibonacci.py (3.7.0) 


k A function to list the n terms of the Fibonacci sequence. 
# Save file as fibonacci.py. 
# Run the Module Cor type F5). 
def fibonacci(n): 
a, b=0, 1 
print(a) 
print(b) 
printCa+b) 
for i in range(n-3): 
a, b = b, a+b 
print(Ca+b) 
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Figure 1.5 File Editor window showing a Python program for listing the first n terms of the Fibonacci 
sequence 


>>> fibonacci(20) 
0,1,1,2,3,5,8,13,21,34,55,89, 144,233,377,610,987,1597,2584,4181 


Example 4. Use the while command to write a Python Program that sums the 
natural numbers to n. 


Solution. The Python program for summing the first n natural numbers is shown 
in Figure 1.6 and the IDLE command line and output is listed below. Run the 
module before entering the IDLE command line. 


@ IDLE File Edit Format Run Options Window Help 


SE a OO a ee ee 
@ @ @ sum_n.py - /Users/sladmin/Documents/Python Programs/sum_n.py (3.7.0) 
# A program that sums the natural numbers to N. 


# Save file as sum_n.py. 
# Run the Module Cor type F5). 


def sum_n(n): 
sum = Q 
i=1 
while i <= n: 
sum += i 
i += 1 # increment counter 


printC'The sum is', sum) 


Let Goto 


Figure 1.6 File Editor window showing a Python program for listing the sum of the first n natural 


numbers. 


>>> sum_n(100) 

The sum is 5050 

(iii) If, elif, else. Examples 5 and 6 illustrate how to use conditional 
statements in programming. 


Example 5. Write a Python program that grades students’ results. 


Solution. A Python program for grading students’ results is shown in Figure 1.7 
and the IDLE command line and output is listed below. Run the module before 
entering the IDLE command line. 


@ IDLE File Edit Format Run Options Window Help 


@ @ @ grade.py - /Users/sladmin/Documents/Python Programs/grade.py (3.7.0) 
# A program to grade student results. 

# Save file as grade.py. 

# Run the Module (or type F5). 


def grade(score): 
if score >= 70: 


letter = 'A' 
elif score >= 60: 

letter = 'B' 
elif score >= 50: 

letter = 'C' 
elif score >= 40: 

letter = 'D' 
else: 

letter = 'F' 


return letter 


Ln: 1 Col: 0 


Figure 1.7 File Editor window showing a Python program for grading student results. 


>>> grade(90) 
7A?’ 


Example 6. Write an interactive Python program to play a “guess the number” 
game. The computer should think of a random integer between 1 and 20 and the 
user (player) has to try to guess the number within six attempts. The program 
should let the player know if the guess is too high or too low. 


Solution. The Python program for playing the guess the number game is shown 
in Figure 1.8. 

The program for Example 6 is the first program that has imported a module. 
In order to use Python to study Dynamical Systems more modules and libraries 
have to be imported as demonstrated in the following sections and subsections. 


E 


@ IDLE File Edit Format Run Options Window Help 


@ @ ® guess_number.py - /Users/sladmin/Documents/Python Programs/guess_number.py (3.7.0) 

# Guess the number game. 

# Save file as GuessNumber. 

# Run the Module (or type F5). 


import random # Import the random module. 


num_guesses = 0 

name = input('Hi! What is your name? ') 

number = random.randint(1, 20) # A random integer between 1 and 20. 
printC'Welcome, {}! I am thinking of an integer between 1 and 20.'.format(name)) 


while num_guesses < 6: 
guess = int(inputC('Take a guess and type the integer? ')) 
num_guesses += 1 


if guess < number: 

printC'Your guess is too low.') 
if guess > number: 

printC'Your guess is too high.") 
if guess == number: 

break 


if guess == number: 


printC'Well done {}! You guessed my number in {} guesses!'.formatC(name, num_guesses)) 
else: 


printC'Sorry, you lose! The number I was thinking of was {}'.formatCnumber)) 


Ene 1 Coko 


Figure 1.8 File Editor window showing a Python program for playing the guess the number game. 


Figures 1.3—1.8 were screen shots of the IDLE file editor window and the 
reader should now be familiar with the color command codes used by Python; 


the remaining program files are listed in the text between horizontal lines and the 
color coding has been omitted. 


1.1.3 Tutorial Three: Simple Plotting Using the Turtle Module 
Python comes with the turtle module (turtle.py) already built in and functions 
within the module enable users to move the turtle around the screen to create 
graphics. In order to import the turtle module and its files one simply types >>> 


from turtle import * inthe IDLE Editor window. Readers interested in 

more detail on the Turtle module are directed to the Kindle books [14] and [16]. 
The Turtle module is an excellent tool for plotting fractals as the next three 

examples demonstrate. Fractals are discussed in more detail in Chapter 17 


Example 7. Write a Python program that plots a fractal tree. 


Solution. A Python program for plotting fractal trees is listed below. See 
Figure 1.9. 


# A program for plotting fractal trees. 

# Save file as fractal_tree_color.py. 

# Remember to run the Module (or type F5). 

# Run Module and type >>> fractal_tree_color(200, 10 
) in the Python Shell. 

from turtle import * 


setheading(90) # The turtle points st 
raight up. 

penup() # Lift the pen. 

setpos(0, -250) # Set initial point. 

pendown( ) # Pen down. 


def fractal_tree_color(length, level): 


Draws a fractal tree 
pensize(length/10) # Thickness of lines. 
if length < 20: 
pencolor ("green") 
else: 
pencolor ("brown") 


speed(0) # Fastest speed. 
if level > 0: 
fd( length) # Forward. 
rt(30) # Right turn 30 degree 


fractal_tree_color(length*0.7, level-1) 
1t(90) # Left turn 90 degrees 


fractal_tree_color(length*0.5, level-1) 


rt(60) # Right turn 60 degree 
S. 

penup() 

bk(length) # Backward. 

pendown() 


>>> fractal_tree_color(200, 10) 


Figure 1.9 [Python] A color fractal tree when length=200 and level=10. 
Example 8. Write a Python program that plots a Koch square fractal curve. 


Solution. A Python program for plotting a Koch square curve is listed below. 
See Figure 1.10. 


# A program for plotting a Koch square curve. 

# Save file as koch_square.py. 

# Remember to run the Module (or type F5). 

from turtle import * 

def koch_square(length, level): # Koch square func 
tion. 


speed(0) # Fastest speed. 


for i in range(4): 
plot_side(length, level) 
rt(90) 


def plot_side(length, level): # Plot side functi 
on. 
if level==0: 
fd( length) 
return 
plot_side(length/3, level - 1) 
1t(90) 
plot_side(length/3, level - 1) 
rt (90) 
plot_side(length/3, level - 1) 
rt(90) 
plot_side(length/3, level - 1) 
1t(90) 
plot_side(length/3, level - 1) 


>>> koch_square(200, 4) 


-= 


a 


|_| 


Figure 1.10 [Python] (a) Koch square fractal at level 1; (b) Koch square fractal at level 4. Fractals are 
discussed in more detail in Chapter 17 


Example 9. | Write a Python program that plots a Sierpinski triangle fractal. 


Solution. The Python program for plotting a Sierpinski triangle fractal is listed 


below. See Figure 1.11. 


# A program that plots the Sierpinski fractal. 

# Save file as sierpinski.py. 

# Remember to run the Module (or type F5). 

from turtle import * 

def sierpinski(length, level): # Sierpinski functi 
on. 


speed(0) # Fastest speed. 
if level==0: 

return 
begin_fill() # Fill shape. 


color(’red’ ) 


for 1 in range(3): 
sierpinski(length/2, level-1) 
fd( length) 
1t (120) 

end_fill() 


>>> sierpinski(200, 4) 


a b 


Figure 1.11 [Python] (a) Sierpinski triangle fractal at level 1; (b) Sierpinski triangle fractal at level 4. 
Fractals are discussed in more detail in Chapter 17 


1.2 Anaconda, Spyder and the Libraries, 
Sympy, Numpy, and Matplotlib 


The first section introduces the reader to Python using the IDLE editor; however, 
in order to perform scientific computing and computational modeling additional 


libraries (or packages) that are not part of the Python standard library are 
required. The additional libraries required for this book include sympy 
(SYMbolic PYthon) for symbolic computation, numpy (NUMeric PYthon) for 
numerical routines, and matplotlib (PLOTting LIBrary) for creating plots. 
Python has a number of interpreters along with packages and editors and the 
author has found that the Anaconda free package manager, environment 
manager and Python distribution is one of the best for dynamical systems work. 
Readers may also be interested in alternatives to Anaconda such as WinPython 
and Enthought Canopy . The Anaconda Python distribution is available for 
download for Windows, Mac OS, and the Linux operating systems. The current 
URL to download Anaconda is at: 

https://www.continuum.io/downloads 

Readers should click on the Anaconda Navigator icon and a window opens 
as displayed in Figure 1.12. 


ft Home 


Applications on root ~| — Channels Refresh 


& Environments 


x & % 
a a 
ean A 4w, 
fam Projects (beta) jupyter IPty A 
`w 
O . notebook tconsole spyder 
Ri Learning q py 
A 43.1 A 42.1 A 3.1.2 
Web-based, interactive computing notebook PyQt GUI that supports inline figures, proper Scientific PYthon Development 
HA Community environment. Edit and run human-readable multiline editing with syntax highlighting, EnviRonment. Powerful Python IDE with 
docs while describing the data analysis. graphical calltips, and more. advanced editing, interactive testing, 
debugging and introspection features 
Launch Launch Launch 
Q x 
a 
Documentation x 
‘ay 
` 
Developer Blog : : 
anaconda-fusion glueviz 
Feedback 1.0.2 0.9.1 
Integration between Excel ® and Anaconda Multidimensional data visualization across 
via Notebooks. Run data science Functions, files. Explore relationships within and among 
Y interact with results and create advanced related datasets. Æ | 
vy lon vienalizatinne in 2 rada.Ffraa ann incida Eveal 


Figure 1.12 The Anaconda Navigator window on a Mac OS. 


By clicking on the Launch button under the Spyder icon (see Figure 1.12) an 
Integrated Development Environment (IDE) or notebook opens as displayed in 
Figure 1.13. The three windows are described below: 


1 


The editor window is used to write code and save to file. 


The variable/file explorer window can display detailed help on variables or 
files and is useful when debugging. 


The console window is where one can work interactively and where output 
results and error messages are displayed. The console can be used in the 
same way as the IDLE editor window - see Subsection 1.1.1. 


Note that when saving a file and running the code the file should be located 
in the working directory indicated in the top right corner of the IDE. 


1.2.1 Tutorial One: A Tutorial Introduction to Sympy 

Sympy is a computer algebra system and a Python library for symbolic 

mathematics written entirely in Python. The following tutorial has been designed 

to allow new users to become familiar with the commands by means of example. 

For more detailed information please refer to sympy’s document pages at: 
http://docs.sympy.org/latest/index.html 


(E E] Spyder (Python 3.6) 

D ALEO > Ba CP i Evy EBX A é XD wserssiaamin Dat 
00 Editor - /Users/sladmin/untitled0.py 60 Variable explorer 
© \@ untitled0.py | < ERE % 


ar à Type Size Value 
3 vu 
4 Created on Thu Jul 13 08:48:44 2017 


= sladmin Va ria ble/File Explorer 


JAJIL File explorer 
00 IPython console 
Qe Console 1/A | 4 


A Python 3.6.0 |Anaconda custom (x86_64)| (default, Dec 23 2016, 13:19:00) 
Editor Type "copyright", "credits" or "license" for more information. 
IPython 5.1.0 -- An enhanced Interactive Python. 
? 


-> Introduction and overview of IPython's features. 
%quickref -> Quick reference. 
help -> Python's own help system. 
object? -> Details about ‘object’, use ‘object??' for extra details. 


In [1]: 
Permissions: RW End-of-lines: LF Encoding: UTF-8 Line: 9 Column: 1 Memory: 73 % 


Figure 1.13 A Spyder IDE (notebook) showing the Editor window, the Variable/File Explorer window, 
and the Console window. 


The following command lines should be typed in the console window. There 
is no need to copy the comments, they are there to help you. 


Python Commands Comments 


In[1]: 2 3+4 5 


tt 


Approximate decimal. 
In[2]: from fractions import Fraction |# To work with fractions. 


In[3]: Fraction(2, 3)+Fraction(4, 5) # Symbolic answer. 


In[4]: sqrt(16) # Square root. 

In[5]: sin(pi) # Trigonometric function. 

In[6]: from sympy import * # Import everything from sympy 
# library into global scope. 

In[7]: x,y=symbols(’x y’) # Declare x and y symbolic. 

In[8]: factor(x**3 - y**3) # Factorize. 

[In[9]: expand(out(8]) = stk Expand the last result. 

In[10]: factor((x**3 - y**3)/(x - y)) |# Simplify an expression. 

(In[11]: apart(1/((x + 2)*(x + 1)))  |# Partial fractions. 

In[12]: trigsimp(cos(x) - cos(x)**3) # Simplify a trig expression. 

In[13]: limit(1/x, x, o0) # Limits. 

In[14]: diff(x**2 - 3*x + 6,x) # Total differentiation. 

In[15]: diff(x**3*y**5, x, y, 3) # Partial differentiation. 

|In[16]: integrate(sin(x)*cos(x),x)  |# Indefinite integration. 

In[17]: integrate(exp(-x**2 - y**2), # Definite integration. 


(x, ©, o0), (y, ©, 00)) 
In[18]: (exp(x)*cos(x)).series(x,0,10) 
In[19]: summation(1 / x**2,(x,1,00)) 
In[20]: solve(x**5 - 1, x) 
In[21]: solve([x+5*y-2, -3*x+6*y-15], 
[x, y]) 
In[22]: z1 = 3 + 1*I; z2 = 5 - 4*I 
In[23]: 2 z1 + z1 z2 


Taylor series expansion. 
An infinite sum. 


Solving equations. Roots 


#] He] He) 


Solving simultaneous equations. 


Note that 1j=I can be used too. 
Simple complex arithmetic. 
In[24]: conjugate(z1) 
In[25]: arg(z1) 
In[26]: abs(z1) 
In[27]: re(z1) 


Complex conjugate. 
The argument of z1. 


The modulus of z1. 


H+] He] He) He) HY] ~ 


The real part. 


In[28]: im(z1) The imaginary part. 

In[29]: exp(1I*z1).expand(complex=True) 

In[30]: A=Matrix([[1, -1], [2, 3]]); 
B=Matrix([[0, 2], [3, 3]]); 

In[31]: 2 A+3 A*B 

In[32]: A.row(0) 

In[33]: A.T 

In[34]: A.T.row(1) 

In[35]: A[0, 1] 

In[36]: A**(-1) 

In[37]: A**5 

In[38]: A.det() 

In[39]: zeros(3, 3) 

In[40]: ones(1, 5) 

In[41]: C=Matrix([[2,1,9], [-1,4,0], 
[-1,3,1]]) 

In[42]: C.rref() 

In[43]: C.eigenvals() 


Express in form x+iy. 


Hy] eR] 


Two 2x2 matrices. 


Matrix algebra. 

Access the first row. 

The transpose of a matrix. 
Access the second column of A. 
The element in row 1, column 2. 
The inverse of a matrix. 

The power of a matrix. 

The determinant of A. 

A 3x3 matrix of zeros. 


A 1x5 matrix of ones. 


H] He] He) HR] HR] HY] KR] HR] RY] HY 


A 3x3 matrix. 


The row reduced echelon form. 


The eigenvalues of C. 


In[44]: C.eigenvects() 
In[45]: s, t, w = symbols(’s t w’) 
In[46]: laplace_transform(t**3,t,s) 


The eigenvectors of C. 
Declare s,t,w symbolic. 


Laplace transform. 


+H] He] He) He) HY] 


Inverse transform. 


In[47]: inverse_laplace_transform 
(6/s**4, s, t) 
In[48]: fourier_transform(-2 pi # Fourier transform. 
abs(t), t, w) 
In[49]: inverse_fourier_transform(1/ # Inverse transform. 
(pi w*2), w, t) 
In[50]: quit 


Quits IPython console. 


+ 


1.2.2 Tutorial Two: A Tutorial Introduction to Numpy and 
Matplotlib 

Numpy’s main object is the homogeneous multidimensional array and allows 
Python to compute with vectors and matrices. Matplotlib is a Python 2- 
dimensional plotting librarv used to generate bar charts. error charts. histograms. 


plots, power spectra, and scatterplots, for example. When combining the pyplot 
module with [Python a MATLAB.-like interface is provided and the user can 
control axes properties, font properties, and line styles via an object oriented 
interface. For a more detailed reference guide to numpy, readers are directed to: 

https://docs.scipy.org/doc/numpy/reference/ 

and an introduction to matplotlib is given here: 

https://matplotlib.org 

The following command lines provide a concise introduction to numpy and 
matplotlib by means of example. The following command lines should be typed 
in the [Python console window. There is no need to copy the comments, they are 
there to help you. 


In[1]: import numpy as np 

In[2]: a = np.arange(5) 

In[3]: b = np.arange(6).reshape(2,3) 
In[4]: A = np.array([[1, 1], [0, 1]]) 
In[5]: B = np.array([[2, 0], [3, 4]]) 
In[7]: A.dot(B) 


In[9]: c=np.arange(12).reshape(3, 4) 


agg 


In[19]: plt.plot(x, y) 


1 
1 
: = 0) 
In[11]: c.min(axis = 1) 
A is = 1) 
1 1 
Ty 


In[8]: np.dot(A, B) 


In[20]: # Two plots on one graph 


In[21]: t = np.linspace(0, 100, 1000); 


p1 = np.exp(-.1*t) * np.cos(t); 


plt.plot(t, p1);plt.plot(t, p2); 
In[27]: plt.plot(x,y,color = ’green’, linewidth = 4) 
In[29]: x, y=np.mgrid[-5:5:100j, -5:5:100] ] 

Z = x**2 / 4 + y**2 


In[31]: t=np.linspace(0, np.pi, 100); 


1.2.3 Tutorial Three: Simple Programming, Solving ODEs, and 
More Detailed Plots 


In order to solve ordinary differential equations (ODEs) and produce more 
detailed plots the reader is advised to write short programs rather than using the 
console window. Examples are listed below, where each file is listed between 
horizontal lines and the output is also included in the indicated figures. 

Readers can get help from within the Python console using the help 
command . For example, by typing >>>help(dsolve), information and examples 
are listed in the console. 

Hints for Programming . 


Indentation: The indentation level in Python code is significant. 


Common typing errors : Include all operators, make sure parentheses match 
up in correct pairs, Python is case sensitive, check syntax using the help 
command. 


Use continuation lines : Use a backslash to split code across multiple lines. 
Preallocate arrays using the zeros command. 


If a program involves a lot of iterations, 100,000, say, then run the code for 
two iterations initially and use print. 


Read the warning messages supplied by Python before running the code. 
Check that you are using the correct libraries and modules. 


If you cannot get your program to work, look for similar programs 
(including Maple, Mathematica, and MATLAB programs) on the World 
Wide Web. 


Example 10. | Write a Python program that solves the ODE: i +x=1- 


Solution. The Python program for solving the ODE is listed below. 


# Program 01a: A program that solves a simple ODE. 
from sympy import dsolve, Eq, symbols, Function 

t = symbols(’t’) 

x = symbols(’x’, cls=Function) 

deqni = Eq(x(t).diff(t), 1 - x(t)) 

soli = dsolve(deqni, x(t)) 

print(sol1) 


Eq(x(t), C1*exp(-t) + 1) 


Example 11. Write a Python program that solves the ODE: ay , dy 


dt? dt +ty=e 


f: 


Solution. The Python program for solving the second order ODE is listed below. 


# Program 01b: A program that solves a second order 
ODE. 
from sympy import dsolve, Eq, exp, Function, symbol 


symbols(’t’ ) 
symbols(’y’, cls=Function) 
eqn2 = Eq(y(t).diff(t,t) + y(t).diff(t) + y(t), ex 
p(t) ) 
sol2 = dsolve(deqn2, y(t)) 
print(sol2) 


t 
y 
d 


Eq(y(t),(C1*sin(sqrt(3)*t/2)+C2*cos(sqrt(3)*t/2))/sqrt(exp(t))+exp(t)/3) 
Example 12. Write a Python program that plots two curves on one graph. 
Solution. The Python program for plotting Figure 1.14 is listed below. 


Voltage-time plot 


voltage (mV) 


0.00 0.25 0.50 O75 1.00 1.25 1.50 175 2.00 
time (s) 


Figure 1.14 [Python] A voltage time plot. Note that ’r—’ gives a red dashed curve and ’b-.’ gives a blue 
dash-dot curve. Using savefig, the figure is saved in the same folder where the python program is stored. 


# Program O1ic: A program that plots two curves on o 
ne graph. 

# Remember to run the Module (or type F5). 

import matplotlib.pyplot as plt 

import numpy as np 


t = np.arange(0.0, 2.0, 0.01) 
c = 1 + np.cos(2*np.pi*t) 
s = 1 + np.sin(2*np.pi*t) 


plt.plot(t, s, ‘r--’, t, c, ‘b-.’) 
plt.xlabel(’time (s)’) 
plt.ylabel(’voltage (mV)’) 
plt.title(’Voltage-time plot’) 
plt.grid(True) 
plt.savefig("Voltage-Time Plot.png") 
plt.show() 


Example 13. Write a Python program that plots subplots. 
Solution. The Python program for plotting Figure 1.15 is listed below. Note that 


the syntax for the subplot command is subplot(number of rows, number of columns, figure 
number). 


Damped pendulum 


E€ @ damping 

g — damping 

= 

= 0 

Qa 

E 

Oo 

0 1 2 3 4 5 
time (s) 


Undamped pendulum 


amplitude (m) 
=] 


time (s) 


Figure 1.15 [Python] Two subplots for a damped and undamped pendulum. The upper plot also has a 
figure legend. 


# Program 01d: A program that plots subplots. 
# Remember to run the Module (or type F5). 
import matplotlib.pyplot as plt 

import numpy as np 


def f(t): 
return np.exp(-t) np.cos(2np.pi*t) 


t1 
t2 


np.arange(0.0, 5.0, 0.1) 
np.arange(0.0, 5.0, 0.02) 


plt.figure(1) 

plt.subplot(211) #subplot(num rows,num cols,fig nu 
m) 

plt.plot(t1,f(t1), ‘bo’, t2, f(t2), ’k’, label='dam 
ping’ ) 

plt.xlabel(’time (s)’) 

plt.ylabel(’amplitude (m)’) 


plt.title(’Damped pendulum’ ) 
legend = plt.legend(loc=’upper center’, shadow=True 


) 


plt.subplot(212) 

plt.plot(t2, np.cos(2*np.pi*t2), ‘g- 
-’, linewidth=4) 

plt.xlabel(’time (s)’) 

plt.ylabel(’amplitude (m)’) 

plt.title(’Undamped pendulum’) 


plt.subplots_adjust(hspace=0.8) 
plt.show() 


Example 14. Write a Python program that plots a surface and corresponding 
contour plots in 3D. 


Solution. The Python program for plotting Figure 1.16 is listed below. 


Surface and contour plots 


Potential 


Figure 1.16 [Python] A surface and contour plot. Note that the font size of ticks and axis labels have also 
been set. In this case the axis labels are generated with LaTeX code. 


# Program O1e: A program that plots a surface and c 
ontour plots in 3D. 


# Remember to run the Module (or type F5). 
import numpy as np 

import matplotlib.pyplot as plt 

from mpl_toolkits.mplot3d import Axes3D 


ay 
2 np.pi 0.5 


def flux_qubit_potential(phi_m, phi_p): 
return 2+alpha-2*np.cos(phi_p)*np.cos(phi_m) - 
alpha*np.cos 
(phi_ext-2*phi_p) 


phi_m = np.linspace(0, 2 * np.pi, 100) 
phi_p = np.linspace(0, 2 * np.pi, 100) 
X,Y = np.meshgrid(phi_p, phi_m) 

Z = flux_qubit_potential(X, Y).T 


fig = plt.figure(figsize = (8, 6)) 


ax=fig.add_subplot(1, 1, 1, projection=’3d’ ) 
p=ax.plot_wireframe(X, Y, Z, rstride=4, cstride=4) 
ax.plot_surface(X, Y, Z, rstride=4, cstride=4, alph 
a=0.25) 
cset=ax.contour(X,Y,Z,zdir='’z’, offset=- 
np.pi, cmap=plt.cm.coolwarm) 
cset=ax.contour(X,Y,Z,zdir=’x’, offset=- 
np.pi, cmap=plt.cm.coolwarm) 
cset=ax.contour(X,Y,Z,zdir=’y’, offset=3*np.pi, cma 
p=plt.cm.coolwarm) 


ax.set_xlim3d(-np.pi, 2*np.p1); 

ax.set_ylim3d(0, 3*np.pi); 

ax.set_zlim3d(-np.pi, 2*np.p1); 
ax.set_xlabel(’$\phi_p$’, fontsize=15) 
ax.set_ylabel(’$\phi_m$’, fontsize=15) 
ax.set_zlabel(’Potential’, fontsize=15) 
plt.tick_params(labelsize=15) 

ax.set_title("Surface and contour plots", fontsize=1 


5) 
plt.show() 


Example 15. Write a Python program that plots a parametric plot in 3D. 


Solution. The Python program for plotting Figure 1.17 is listed below. 


3D Parametric Curve 


Z Axis 


Figure 1.17 [Python] A parametric plot in 3D. 


# Program 01f: A program that plots a parametric cu 
rve in 3D. 

# Remember to run the Module (or type F5). 

import numpy as np 

import matplotlib.pyplot as plt 

#from mpl_toolkits.mplot3d import Axes3D 


fig = plt.figure(figsize=(8, 6)) 
ax = fig.add_subplot(1, 1, 1, projection=’ 3d’ ) 


t = np.linspace(-10, 10, 1000) 
x = np.sin(t) 
y = np.cos(t) 


z=t 

ax.plot(x, y, Z) 

ax.set_xlabel("X Axis") 
ax.set_ylabel("Y Axis") 
ax.set_zlabel("Z Axis") 
ax.set_title("3D Parametric Curve") 
plt.show() 


Example 16. Write a Python program that animates a simple curve. 
Solution. The Python program for producing an animation is listed below. 


# Program 01g: A program that animates a simple cur 
ve. 

# Remember to run the Module (or type F5). 

import numpy as np 

from matplotlib import pyplot as plt 

from matplotlib import animation 

fig = plt.figure() 

ax = plt.axes(xlim=(0, 2), ylim=(-2, 2)) 

line, = ax.plot([], [], lw=2) 

plt.xlabel(’time’ ) 

plt.ylabel(’sin($\omega$t )’ ) 


def init(): 
line.set_data([], []) 
return line, 


# The function to animate. 
def animate(i): 
x = np.linspace(0, 2, 1000) 
y =np.sin(2 np.pi (0.1 x i)) 
line.set_data(x, y) 
return line, 


# Note: blit=True means only re- 
draw the parts that have changed. 
anim=animation.FuncAnimation(fig, animate, init_fun 
c=init, \ 


=200, 


frames=100, interval 
blit=True) 


plt.show() 


Readers may be interested in my other Dynamical Systems books based on 
Mathematica , MATLAB ,„ and Maple , [7, 8, 9], where introductory chapters 
provide tutorial guides to those packages. 


1.3 Exercises 


Simple Python programming. 


(a) 


(b) 


(c) 


(d) 


(e) 


Write a function for converting degrees Fahrenheit to degrees 
Centigrade. 


Write a Python program that sums the subset of prime numbers up to 
some natural number, n, say. 


Consider Pythagorean triples, positive integers a, b, c, such that a 24 
b ? = c ?. Suppose that c is defined by c = b + n, where n is also an 
integer. Write a Python program that will find all such triples for a 
given value of n, where both a and b are less than or equal to a 
maximum value, m, say. For the case n = 1, find all triples with 1 < a 
< 100 and 1 < b < 100. For the case n = 3, find all triples with 1 < a < 
200 and 1 < b < 200. 


Edit the Koch square Python program to plot a Koch snowflake, 
where each segment is replaced with 4 segments, each one-third the 
length of the previous segment. Use an equilateral triangle as a base. 


Edit the sierpinski.py Python program to construct a Sierpinski square 
fractal, where the central square is removed at each stage and the 
length scales decrease by one-third. 


Evaluate the following: 


(a) 


(b) 


4+5-6; 


12. 
3% 


c) 
sin(0. 17r); 
(d) 
(2 = 3 = 43 +701 =- (263 - 5))))); 
(e) De Bega 
oa 
Given that 
1 2 -l 12 3 2 1 | 
A=] 0 1 0 |, B8=|112]ļ|, C=|0 I -I ], 
3 -1 2 0 12 42 2 
determine the following: 
(a) 
A + 4BC; 
(b) ee 
the inverse of each matrix if it exists; 
© ys 
(d) l 
the determinant of C; 
(e) 


the eigenvalues and eigenvectors of B. 


Given that z 4 = 1 +i, Z =-2 + i and z 3 = —i, evaluate the following: 


(a) 
ZįtZ27Z3; 
(b) 
Z172 » 
3 
z3 
o 
e~l; 


In(z 4); 


(e) 
sin(z 3). 


Evaluate the following limits if they exist: 


a) S 
lim,.9 =e 

(b) Ea 
; WII, 
liM, EET i 

) +1 
: cos x+1 - 
DM a 

@Q a 
limot >? 

(e) 
limo 2 sinh x-2sin x , 


cosh x-1 


Find the derivatives of the following functions: 


(a) 


y =3x3+2x2-5; 
(b) | 
y= Vl4+x% 
(c) l 
y = e *sinxcosx; 
(d) 
y = tanhx; 
(e) i 
yx 


Evaluate the following definite integrals: 


(f) 


foen Bx hk = 5 dx 


(g) 7 
Í L dx 


val x4 
C 

oa e* dx 
O | 

i adv’ 
(j) 


sito 


sin(1/) g; 
S E dt 


Í 


Graph the following: 
(a) 

y=3x?+2x?-5; 
(b) 

y=e 
(c) 

x? -2xy-y?°?=1; 
(9) 2 ia 

z=4x-e’-2x"-e”, for-3<x<3and-1<y<1; 


(e) : i 
x=t°-3t,y=t’-9t, for-4<t<4. 


=, for- 5 <x <5; 


Solve the following differential equations: 


(a) | 
dy _ x, given that y(1) = 1; 
dx 2y 

(b) l 
dy _ 3, given that y(2) = 3; 
dx x 

(c) 


dy x , given that y(0) = 1; 
y 


(dì 


dx dx -.—_ N, gi that x(0) = 1 and (0 =0; 
+54 46x =0 given that x(0) = 1 and x(0) 


dt? 


(e) 


ax y 54 + 6x = sin(ty given that x(0) = 1 and x(Q) = 0. 
2 at * 


Carry out one hundred iterations on the recurrence relation 
Xn+1 = 4xnC1 E Xa): 


given that (a) x ọ = 0. 2 and (b) x ọ = 0. 2001. List the final ten iterates in 


each case. 


10. 
Use a while loop to program Euclid’s algorithm for finding the greatest 


common divisor of two integers. Use your program to find the greatest 
common divisor of 12348 and 14238. 
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2. Differential Equations 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To review basic methods for solving some differential equations. 
e To apply the theory to simple mathematical models. 
e To introduce an existence and uniqueness theorem. 


On completion of this chapter, the reader should be able to 


solve certain first-and second-order differential equations; 

apply the theory to chemical kinetics and electric circuits; 

interpret the solutions in physical terms; 

understand the existence and uniqueness theorem and its implications. 


The basic theory of ordinary differential equations (ODEs) and analytical 
methods for solving some types of ODEs are reviewed. This chapter is not 
intended to be a comprehensive study on differential equations, but more an 
introduction to the theory that will be used in later chapters. Most of the 
materials will be covered in first-and second-year undergraduate mathematics 
courses. The differential equations are applied to all kinds of models, but this 
chapter concentrates on chemical kinetics and electric circuits in particular. 

The chapter ends with the existence and uniqueness theorem and some 
analysis. 


2.1 Simple Differential Equations and Applications 


Definition 1. A differential equation that involves only one independent 
variable is called an ordinary differential equation (ODE). Those involving two 
or more independent variables are called partial differential equations (PDEs). 


This chapter will be concerned with ODEs only. 


The subject of ODEs encompasses analytical, computational, and applicable 
fields of interest. There are many textbooks written from the elementary to the 
most advanced, with some focusing on applications and others concentrating on 
existence theorems and rigorous methods of solution. This chapter is intended to 
introduce the reader to all three branches of the subject. For more information 
the reader should consult the ODE textbooks in the bibliography [1, 6, 7, 10, 15]. 


2.1.1 Linear Differential Equations 


Consider differential equations of the form 


2 + P(t)x = Q(t). (2.1) 
Multiplying through by an integrating factor , say, J(t), (2.1) becomes 
I aaO (2.2) 
dt 


Find J such that (2.2) can be written as 


d dx dJ 
—(Jx) = J— + x— = JỌ. 
Ff aa alt a aa 
In order to achieve this, set 
dJ 
— = JP 
dt 


and integrate to get 


J(t) = exp [fro ar), 


Thus the solution to system (2.1) may be found by solving the differential 
equation 


d 
ke eee 


as long as the right-hand side is integrable. 


Example 1. A chemical company pumps v liters of solution containing mass m 
grams of solute into a large lake of volume V per day. The inflow and outflow of 
the water are constant. The concentration of solute in the lake, say, o, satisfies 
the differential equation 


do r v m : 
—+-—g = —. 
dt VV 22) 


Determine the concentration of solute in the lake at time t assuming that o = 
0 when t = 0. What happens to the concentration in the long term? 


Solution. This is a linear differential equation, and the integrating factor is given 


by 
vV ví 
J= —dt| = ev. 
a |7 | e 


Multiply (2.3) by the integrating factor to obtain 


Integration gives 


where k is a constant. Substituting the initial conditions, the final solution is 
m vi 
olt) = —(1 —e Y). 
y 


As t > 0, the concentration settles to “ g/-!. 
y © 


2.1.2 Separable Differential Equations 


Consider the differential equation 


dx 


7 = f(t, x) (2.4) 


and suppose that the function f(t, x) can be factored into a product f(t, x) = 
g(Ðh(x), where g(t) is a function of t and h(x) is a function of x. If f can be 


factored in this way, then equation (2.4) can be solved by the method of 
separation of variables . 
To solve the equation, divide both sides by h(x) to obtain 


and integration with respect to t gives 


l dx 
| at= | soa 


Changing the variables in the integral gives 


dx 
f oS slo) de. 


An analytic solution to (2.4) can be found only if both integrals can be 
evaluated. The method can be illustrated with some simple examples. 


Example 2. Solve the differential equation = Sik, 
(4 x 


Solution. The differential equation is separable. Separate the variables and 
integrate both sides with respect to t. Therefore, 


dx 

—dt=- | tdt, 
oF | 
frax=- [tae 


Integration of both sides yields 


and so 


2 > 
t + a =r, 


where r ° is a constant. There are an infinite number of solutions. The solution 
curves are concentric circles of radius r centered at the origin. There are an 
infinite number of solution curves that would fill the plane if they were all 
plotted. Three such solution curves are plotted in Figure 2.1. 


Figure 2.2 Six solution curves for Example 3. 


Example 3. Solve the differential equation = — +. 
G X= 


Solution. The differential equation is separable. Separate the variables and 
integrate both sides with respect to t to give 


feas frar 


Integration of both sides yields 


where C is a constant. Six of an infinite number of solution curves are 
plotted in Figure 2.2. 


Example 4. 
The population of a certain species of fish living in a large lake at time t can be 
modeled using Verhulst’s equation , otherwise known as the logistic equation , 


dP 
— = P(G- oP), 
dt 


where P(t) is the population of fish measured in tens of thousands, and p and 6 
are constants representing the birth and death rates of the fish living in the lake, 
respectively. Suppose that B = 1, 6 = 10°, and the initial population is N = 800. 
Solve this initial value problem and interpret the results in physical terms. 


Solution. Using the methods of separation of variables gives 


J gam J 


The solution to the integral on the left may be determined using partial fractions. 
The solution is 
BNE 


Po= aa 
a B- 8N + Nôe®! 


computed using Python. Substituting the parameters listed in the question, the 
solution is 


800 


Pt) = — 
0.8 + 0.2e7 


Thus as time increases, the population of fish tends to a value of 1000. The 


solution curve is plotted in Figure 2.3. 


P(t) 
1000 


950 
900. 


850 


- -t 
10 20 30 40 50 


Figure 2.3 The solution curve for the initial value problem in Example 4. 
Note the following: 
e The quantity £ is the ratio of births to deaths and is called the carrying 
ô 


capacity of the environment. 

e Take care when interpreting the solutions. This and similar continuous models 
only work for large species populations. The solutions give approximate 
numbers. Even though time is continuous, the population size is not. For 
example, you cannot have a fractional living fish, so population sizes have to 
be rounded out to whole numbers in applications. 

e Discrete models can also be applied to population dynamics (see Chap. 13). 


2.1.3 Exact Differential Equations 
A differential equation of the form 
d 
M(t, x) + N(t, D -0 (2.5) 
dt 


is said to be exact if there exists a function, say, F(t, x), with continuous 
second partial derivatives such that 


WG F OF _ ug 
a ,x), an a (t, xX). 


Such a function exists as long as 
OM ON 
‘Ox Of 
and then the solution to (2.5) satisfies the equation 
F(t, x) = C, 


where C is a constant. Differentiate this equation with respect to t to obtain 
(2.5). 


Example 5. 
Solve the differential equation 


dx 9-12t- 5x 
dt St+2r-=-4" 


Solution In this case, M(t, x) = -9 + 12t + 5x and N(t, x) = 5t + 2x - 4. Now 
OM óN | 


Ox Or 


and integration gives the solution F(t, x) = x ° + 6t? + 5tx — 9t — 4x = C. There 
are an infinite number of solution curves, some of which are shown in 
Figure 2.4. 


—6 
Figure 2.4 Some solution curves for Example 5. 
2.1.4 Homogeneous Differential Equations 
Consider differential equations of the form 


Ln (=). (2.6) 


Substitute v = = into (2.6) to obtain 


d 
T0) = fO). 


Therefore, 


dv 
v+ E =J) 


and so 


dv f)-v 
dt — t 


4 


which is separable. A complete solution can be found as long as the 
equations are integrable, and then v may be replaced with +. 


Example 6. 
Solve the differential equation 


dx t-x 
dt t+x 


Solution. The equation may be rewritten as 
dx _ [= 
dt 1+ 


Let v = =. Then (2.7) becomes 


=~% 


(2.7) 


~is 
. 


dv | =o 
dt = t(1+v) 

This is a separable differential equation. The general solution is given by 
4 +x- =C 


where C is a constant. Some solution curves are plotted in Figure 2.5. 


4 


Figure 2.5 Some solution curves for Example 6. 


In most cases, especially in ODE models of real world problems, the ODEs 
do not have nice analytical solutions and numerical methods need to be 
employed to make any progress. This is particularly true for nonlinear systems 
as seen in other chapters of this book. 

Numerical and Series Solutions of ODEs 

To integrate a system of ODEs numerically, one uses the odeint function from 
the scipy.integrate library (see Program 02e, in Section 2.5). For more detail on the 
numerical solution of ODEs, the reader is directed to [5]. Note that numerical 
solutions of ODEs are used extensively in other chapters of the book. 

Another very useful method for determining the solutions to some ODEs is 
the series solution method. The basic idea is to seek a series solution (assuming 
that the series converge) of the form 


CO 


x)= $ dalt — to)", 


n=0 


about the point t 5. The method holds for infinitely differentiable functions 


(that is, functions that can be differentiated as often as desired), and is outlined 
using two simple examples. 


Example 7. Determine a series solution to the initial value problem 


Caner 2.8 
—— y= = 3 : 
dt (aa 


given that x(0) = 1. 


Solution. Given that t ọ = 0, set x(t) = È} ,-9 ~ a, t”. Substituting into (2.8) 
gives 


Sapta [> ct =p 


n=! n=0 


Combining the terms into a single series 


a, + ` (at Daata =r. 


n=) 
Equating coefficients gives 
a, = 0, 2a. + dg = 0, 3a3 + a; = 0, 4a4 + a = 1,5d5 + a3 =0,... 
and solving these equations gives a 5,,, = 0, for n = 0, 1, 2,..., 


do l-a 
C 4.” 


and 
— _ n2 
an Z7 5 


2n 


where n = 3, 4, 5,.... Based on the assumption that x(t) = È ,=-9 ~a,t", 
substituting x(0) = 1 gives a ọ = 1. Hence, the series solution to the ODE (2.8) is 


P mii 13 
a) = 15H + ten ssa 33 i 


A Python program for calculating the series solution is listed in Section 2.5. 
Note that the analytic solution can be found in this case and is equal to 


x(t) = -24+°43e°7, 


which is equivalent to the series solution above. 


Figure 2.6 [Python] Numerical and truncated series solutions for the ODE (2.9) near x(0) = 1. 


Example 8. Consider the second order ODE given by: 


aX dx 
gtg t4= 0. (2.9) 


where x(0) = 1 and x(0) = 0. Use Python to plot a numerical solution 


against a series solution up to order 6 near to the point x(0) = 1 


Solution. Using Python, the series solution is computed to be 


p t+ £ 4 
E a EA EE 


Substituting the initial conditions gives C , = 0 and C , = 1. Figure 2.6 shows the 
truncated series and numerical solutions for the ODE (2.9) near to x(0) = 1. The 


upper red curve is the truncated series approximation that diverges quite quickly 
away from the numerical solution (lower blue curve). Of course, one must also 
take care that the numerical solution is correct. 


2.2 Applications to Chemical Kinetics 


Even the simplest chemical reactions can be highly complex and difficult to 
model. Physical parameters such as temperature, pressure, and mixing, for 
example, are ignored in this text, and differential equations are constructed that 
are dependent only on the concentrations of the chemicals involved in the 
reaction. This is potentially a very difficult subject and some assumptions have 
to be made to make progress. 

The Chemical Law of Mass Action . The rates at which the concentrations 
of the various chemical species change with time are proportional to their 
concentrations. 

Consider the simple chemical reaction 


A+PB=yC, 
where f and y are the stoichiometric coefficients, A and B are the reactants, C 


is the product, and k , is the forward rate constant of the equation. The rate of 
reaction, say, r, is given by 


change in concentration 


change in time 


For this simple example, 
d[A] 1d[B] © Id{C] 


d B dt 


= Pa = 
r= k\[A][BP = oie ee 


where [A], [B], and [C] represent the concentrations of A, B, and C, 
respectively. By adding a second chemical equation, a slightly more complex 
system is produced, 


vA = 6D, 


where k 5 is the rate constant of the second equation and a and 6 are the 
stoichiometric coefficients. Note that the chemical equations whose 
stoichiometry determines the form of their rates are known as elementary steps . 
Two of the possible reaction rate equations for this system now become 


d{D 
— = —k, B[A][BF — koa [A]", a = k,d[A]". 


Table 2.1 One of the possible reaction rate equations for each chemical reaction. 


Chemical reaction | The reaction rate equation for one species 
may be expressed as follows: 


de _ krab = k¢(ao — c)(bo — c) 


dt 


P =k (ay — 2b)" — k,b 


dt 


= kr (ao Ta 2) = kb? 


de = k (ao = c) = k,(bo + c)(co + c) 


dt 


& = kp(ag — c)(bo — c) — kre 


dt 


& = k (ag — c)(bo = c) — K-(co + (do + ©) 


dt 


Consider the following example, where one molecule of hydrogen reacts 
with one molecule of oxygen to produce two molecules of hydroxyl (OH): 


H: + O; > 20H. 


Suppose that the concentration of hydrogen is [H,] and the concentration of 
oxygen is [O,]. Then from the chemical law of mass action, the rate equation is 
given by 

Rate = k[H2][O>], 
where k is called the rate constant , and the reaction rate equation is 


ila 2k[H2][O2]. 
dt 

Unfortunately, it is not possible to write down the reaction rate equations based 
on the stoichiometric (balanced) chemical equations alone. There may be many 
mechanisms involved in producing OH from hydrogen and oxygen in the above 
example. Even simple chemical equations can involve a large number of steps 
and different rate constants. A rate-determining step is a step in a sequence of 
reactions that is slower than the other steps, so that its rate determines the rate of 


the entire sequence. 
Suppose that species A, B, C, and D have concentrations a(t), b(t), c(t), and 
d(t) at time t and initial concentrations a 9, b 9, € o, and d 9, respectively. Table 


2.1 lists some reversible chemical reactions and one of the corresponding 
reaction rate equations, where k pand k , are the forward and reverse rate 


constants, respectively. 


Example 9. 
A reaction equation for sulfate and hydrogen ions to form bisulfite ions is given 
by 


SO% + H* = HSO}, 
where k pand k , are the forward and reverse rate constants , respectively. Denote 


the concentrations by a = [SO} 2) b = [H*], and c = LHSO3 ], and let the initial 


concentrations be a 9, b ọ, and c 4. Assume that there is much more of species H* 


than the other two species, so that its concentration b can be regarded as 
constant. The reaction rate equation for c(t) is given by 


dc 
on = k (do = c)b = k,(co F c). 


Find a general solution for c(t). 


Solution. The differential equation is separable and 
d 
Í OENE Í dt. 
klao — c)b — k,(co + c) 


(t) kragb — k,co k,Co 
C Tre 
kb + k, kb + k, 


Integration yields 
J Ae ksao-krt 


where A is a constant. 


Example 10. 
The chemical equation for the reaction between nitrous oxide and oxygen to 
form nitrogen dioxide at 25° C, 


2NO + O — 2NOz 


obeys the law of mass action. The rate equation is given by 


dc 3 č 
P k(ay — c)° (bo = <I) 


where c = [NO,] is the concentration of nitrogen dioxide, k is the rate constant, a 
o is the initial concentration of NO, and b ù is the initial concentration of O3. 


Find the concentration of nitrogen dioxide after time t given that k = 0. 007131 2 
M~? s ~t, a o = 4M1 ~t,b o = 1M1 7t, and c(0) = OMI. 


Solution. The differential equation is separable and 


dc 
| arama = J 


Integrating using partial fractions gives 


kt = 


I | 1 1 
+ —In|c — 4|- —In|c — 2|+---1ln2. 
c-4 2 2 4 2 

It is not possible to obtain c(t) explicitly, so numerical methods are employed 
using Python. The concentration of nitrogen dioxide levels off at two moles per 
liter as time increases, as depicted in Figure 2.7. 


eg Sa Ry Se GS Sy 
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Figure 2.7 [Python] The concentration of NO? in moles per liter against time in seconds. 


Chemical reactions displaying periodic behavior will be dealt with in 
Chapter 8 There may be a wide range of time scales involved in chemical 
reactions and this can lead to stiff systems. 


Definition 2. A stiff system is a system of ODEs for which certain numerical 
methods for solving the equation are numerically unstable. Loosely speaking, a 
stiff system of ODEs is one in which the velocity or magnitude of the vector 
field changes rapidly in phase space. 


2.3 Applications to Electric Circuits 


For many years, differential equations have been applied to model simple 
electrical and electronic circuits. If an oscilloscope is connected to the circuit, 
then the results from the analysis can be seen to match very well with what 
happens physically. As a simple introduction to electric circuits, linear systems 
will be considered and the basic definitions and theory will be introduced. The 


section ends with an introduction to the nonlinear circuit element known as the 
memnristor. 

Current and Voltage 

The current I flowing through a conductor is proportional to the number of 
positive charge carriers that pass a given point per second. The unit of current is 
the ampere A. A coulomb is defined to be the amount of charge that flows 
through a cross section of wire in 1 second when a current of 1A is flowing, so 1 
amp is 1 coulomb per second. As the current passes through a circuit element, 
the charge carriers exchange energy with the circuit elements, and there is a 
voltage drop or potential difference measured in joules per coulomb, or volts V. 

Consider simple electric circuits consisting of voltage sources, resistors, 
inductors, and capacitors, or RLC circuits. A series RLC circuit is shown 
schematically in Figure 2.8. The voltage drop across a resistor and the current 
flowing through it are related by Ohm’s Law. 


Figure 2.8 Schematic of a simple RLC series circuit. 


Ohm/’s Law. The voltage drop V across a resistor is proportional to the 
current I flowing through it: 


V = IR, 


where R is the resistance of the resistor measured in ohms (Q). 

A changing electric current can create a changing magnetic field that induces 
a voltage drop across a circuit element, such as a coil. 

Faraday’s Law . The voltage drop across an inductor is proportional to the 


rate of change of the current: 


y pl 
ae 
where L is the inductance of the inductor measured in henries (H). 
A capacitor consists of two plates insulated by some medium. When 
connected to a voltage source, charges of opposite sign build up on the two 
plates, and the total charge on the capacitor is given by 


Í 
qÀ) = qo + { I(s) ds, 
10 
where q ọ is the initial charge. 


Capacitor. The voltage drop across a capacitor is proportional to the charge 
on the capacitor: 


1 1 
V(t) = TIO = T (a + { I(s) as : 


where C is the capacitance of the capacitor measured in farads (F). 

The physical laws governing electric circuits were derived by G.R. Kirchhoff 
in 1859. 

Kirchhoff’s Current Law . The algebraic sum of the currents flowing into 
any junction of an electric circuit must be zero. 

Kirchhoff’s Voltage Law . The algebraic sum of the voltage drops around 
any closed loop in an electric circuit must be zero. 

Applying Kirchhoff’s voltage law to the RLC circuit gives 


Vit Vet Vo = E(t), 


where V p, V z, and V ç are the voltage drops across R, L, and C, respectively, 


and E(t) is the voltage source, or applied electromotive force (EMF) . 
Substituting for the voltages across the circuit components gives 


E + RI + ae E(t) 
dt ct 


Since the current is the instantaneous rate of change in charge, y — 24, this 
dt 


equation becomes 


goa + Rid = = E(t) (2.10) 
di” dt C l 


This differential equation is called a linear second-order differential 
equation . It is linear because there are no powers of the derivatives, and second 
order since the order of the highest occurring derivative is two. This equation 
can be solved by the method of Laplace transforms [12]; there are other methods 
available, and readers should use whichever method they feel most comfortable 
with. The method of Laplace transforms can be broken down into four distinct 
steps when finding the solution of a differential equation: 


rewrite equation (2.10) in terms of Laplace transforms; 
insert any given initial conditions; 

rearrange the equation to give the transform of the solution; 
find the inverse transform. 


The method is illustrated in the following examples. 


Example 11. 
Consider a series resistor-inductor electrical circuit. Kirchhoff’s voltage law 
gives 

dI 

L— + RI = E. 

dt 
Given that L = 10H; R = 2Q, and E = 50sin(t)V, find an expression for the 
current in the circuit if [(0) = 0. 


Solution. Take Laplace transforms of both sides. Then 


10(sf — 1(0)) + 27 = 


se +] 
Inserting the initial condition and rearranging, 


= 2 
(5s + l)= E 
ssl 


and splitting into partial fractions, 
25 1 125 s 125 ji 


e a 
26s% +1 26 +1 126(s-— 1/5) 


Take inverse Laplace transforms to give 


I(t) = = sin(t) — - cos(t) — a 
-26° 26 126 


The periodic expression Ż sin(t) — 42 cos(t) is called the steady state , and the 
20 


26 


L 
5 


term 125-5 is called the transient . Note that the transient decays to zero as t > 


26 
oo, 


Example 12. 


Differentiate equation (2.10) with respect to time and substitute for ¢¢ to obtain 
dt 


dI 7 dI : Ll. db 

d? d C dt’ 

The second-order differential equation for a certain RLC circuit is given by 
dI _dI 


za +57 + 61 = 10 sin(). 


Solve this differential equation given that 7(()) = /(0) = 0 (a passive circuit ). 


Solution. Take Laplace transforms of both sides: 


(s°F — s10) — (0) + 5(s7 — 1(0)) + 67 = =—. 
Vee | 


Substitute the initial conditions to obtain 


10 
st] 


I(s? +55 +6) = 


Splitting into partial fractions gives 
2 1 I S 


T= te 
st+2 643 gs- +1 srt] 


Take inverse transforms to get 


I(t) = 2e°* — e-* + sin(t) — cos(t). 


The Memristor . The examples discussed thus far have concerned electric 
circuits with linear elements; however, nonlinear electric circuits are now 
coming to the fore. It is now widely acknowledged that Professor Leon Chua is 
the father of nonlinear circuit theory. Chua’s famous nonlinear electric circuit is 
discussed in Chapter 8 and the circuit is easy to construct even in school physics 
laboratories. It has long been believed that there are only three fundamental 
passive circuit elements, the capacitor, the inductor, and the resistor. In 1971, 
Chua [2] used mathematics to prove the existence of a fourth fundamental 
nonlinear element which acts like a resistor with memory, he called the new 
device the memristor. The three well-known circuit elements are described by 
the equations 


1 dv do dv 
= i L A R = 8 
C dq di di 


where t is the inverse capacitance, L is inductance, R is incremental 


resistance, v is voltage, i is current, q is charge, and @ is flux. In addition, the 
current and voltage are described by the following physical laws: 


. dq dø 
i = —, v = —. 
dt dt 


This gives five relationships on three elements and leaves a gap in the harmonic 
symmetry of Chua’s aesthetics. Chua discovered the missing functional 
relationship between charge and flux which is given by 


dd 


dq’ 


where M is the memristance. Figure 2.9 displays the relationships between 
the four fundamental elements. 

In 1976, Chua and Kang [3] discovered that a memristor displays a pinched 
hysteresis and suggested that this effect could be used as a test to determine if a 
device could be truly categorized as a memristor. A pinched hysteresis loop is 
demonstrated in Chapter 21 and the Python program for plotting the loop is 
listed within the Python commands section of that chapter. 


Figure 2.9 The memristor: the missing link discovered. 


In 2008, a team at HP Laboratories [13] announced that they had evidence 
that many nanoscale electronic devices which involve the motion of charged 
atomic or molecular species act as memristors. Their analysis was based on 
results from a thin film of titanium dioxide and they are currently building 
devices for computer logic, nanoelectronic memories, and neuromorphic 
computer architectures. A long-term project of HP Labs Research has been the 
development of The Machine, which was supposed to reinvent the fundamental 
architecture of computing. Among the principal components to be used were the 
memristor and silicon photonics using optical communications; unfortunately, in 
June 2015, HP Labs announced that memristors were to be removed from The 
Machine’s roadmap. Some researchers believe that Strukov’s memristor 
modeling equations [13] do not simulate the devices’ physics very well but 
believe that Chang’s and Yakopcic’s models [8] provide a good compromise. 

It is now understood that man-made memristive devices have been around 
for over two hundred years. In 2012, Prodromakis et al. [9] published a paper 
entitled “Two centuries of memristors.” Indeed it is now known that the first 
demonstration of a memristor device took place at the Royal Institution in 1808. 
Sir Humphrey Davy produced a 1000 V carbon arc discharge, and modern 
technology has demonstrated a pinched hysteresis effect in this system. 


Incredibly, natural memristors have been around for hundreds of millions of 
years, and there are memristors in plants and early life forms. Chua [4] shows 
that sodium and potassium ion channel memristors are the key to generating 
action potentials in the Hodgkin-Huxley equations (see Chapter 21) and he 
explains some unresolved anomalies with the original equations. In terms of 
neurobiology, the tutorial shows that synapses are locally passive memristors, 
and that neurons act as locally active memristors. Chua also shows that the 
circuits used to model the Josephson junction effect should include memristor 
elements to explain the workings of these devices accurately. The author and 
Borresen believe it is possible to make super fast low power computers using 
Josephson junctions acting as neurons connected together with memristors 
acting as axons and synapses. More details are provided in Chapter 21. 


2.4 Existence and Uniqueness Theorem 


Definition 3. 
A function f(x) with f : R” — R” is said to satisfy a Lipschitz condition in a 


domain D c ‘k” if there exists a constant, say, L, such that 


|| £0x1) — £(X2) Ils L || x1 — x2 ll, 


where x 4,X 9 E D. 


If the function f satisfies the Lipschitz condition, then it is said to be Lipschitz 
continuous . Note that Lipschitz continuity in x implies continuity in x, but the 
converse is not always true. 

Existence and Uniqueness Theorem. Suppose that f is continuously 
Lipschitz; then for an initial point x ọ E€ D, the autonomous differential equation 


dk « 
— =x = f(x) (2.11) 


has a unique solution, say, Ọ (X 9), that is defined on the maximal interval of 
existence . 
Note that (2.11) is called autonomous as long as f is independent of t. The 


proof of this theorem can be found in most textbooks that specialize in the theory 
of ODEs. As far as the reader is concerned, this theorem implies that as long as f 


is continuously differentiable, i.e., f E C 1(D), then two distinct solutions cannot 
intersect in finite time. 

The following simple examples involving first-order ODEs illustrate the 
theorem quite well. 


Example 13. Solve the following linear differential equations and state the 
maximal interval of existence for each solution: 
(a) x= x, x0)= l; 


E E OE 


(C) = x3, x(0) = 0. 


Solutions. 

(a) The solution to this elementary differential equation is, x(t) = e £, which is 
unique and defined for all t. The maximal interval of existence in this case is —o0 
< t < œ, Note that f(x) = x is continuously differentiable. 

(b) The solution is given by 


1 
x(t) = —, 
(£) a 
which is not defined for t = 1. Therefore, there is a unique solution on the 
maximal interval of existence given by -œ <t < 1. 
(c) The function f(x) = x3 is not continuously differentiable and does not 
satisfy the Lipschitz condition at x = 0. Any function of the form 


i (25:00) for x = C, and x(t) = 0, for x < C serves as a solution to this 
I/73 


initial value problem when C > 0, and there are infinitely many solutions. 

Note that the solution would be unique on the maximal interval of existence 
0 <t< œ if the initial condition was x(1) = 1. 

Consider autonomous differential equations of the form: 


x = f(x), (2.12) 


where x € R”. 


Definition 4. A critical point (equilibrium point , fixed point , stationary point 
) is a point that satisfies the equation x = f(x) = Q. If a solution starts at this 


point, it remains there forever. 


Definition 5. A critical point, say, x 9, of the differential equation (2.12) is 
called stable if given e > 0, there is a 5 > 0, such that for all t > t ọ, IIx(t) -x (8) Il 
< £, whenever ||x(t o) -X g(t o) ll < 6, where x(t) is a solution of (2.12). 


A critical point that is not stable is called an unstable critical point. 


Example 14. Find and classify the critical points for the following one- 
dimensional differential equations. 
(a) x = x; 


(b) = =2; 


(c) y= x-1. 


Solutions. 
(a) There is one critical point at x ọ = 0. If x < 0, then x < 0, and if x > 0, 


then x > 0. Therefore, x ọ is an unstable critical point. Solutions starting either 


side of x ọ are repelled away from it. 
(b) There is one critical point at x ọ = 0. If x < 0, then x > 0, and if x > 0, 


then x < 0. Solutions starting either side of x 9 are attracted towards it. The 


critical point is stable. 
(c) There are two critical points, one at x , = —1 and the other at x , = 1. If x > 


1, then x > 0O;if-1<x<1,then x < 0; andif x <-1, then x > 0. Therefore, 


solutions starting near to x 4, but not on it are attracted towards this point, and x 4 
is a stable critical point. Solutions starting near x 5 but not on it move away from 
this point, and x 5 is an unstable critical point. 


By linearizing near a critical point, one can obtain a quantitative measure of 
stability as demonstrated below. Consider one-dimensional systems here; higher- 
dimensional systems will be investigated in other chapters. 

Linear Stability Analysis 


Let x * be a critical point of x = f(x), x € R. Consider a small 


perturbation , say, &(t), away from the critical point at x * to give x(t) =x * + 
€(t). A simple analysis is now applied to determine whether the perturbation 
grows or decays as time evolves. Now 


f= 4= fx) = fOr + 4), 
and after a Taylor series expansion , 


E 


E= fa") + EF) + 5. 


aCe. oe 
In order to apply a linear stability analysis, the nonlinear terms are ignored. 
Hence 


Sse): 


since f(x *) = 0. Therefore, the perturbation &(t) grows exponentially if f (x *) 
> 0 and decays exponentially if f (x *) < 0. If f(x *) = 0, then higher-order 
derivatives must be considered to determine the stability of the critical point. 

A linear stability analysis is used extensively throughout the realms of 
nonlinear dynamics and will appear in other chapters of this book. 


Example 15. Use a linear stability analysis to determine the stability of the 
critical points for the following differential equations: 
(a) x = sin(x); 


(b) x= x: 
(c) x=e*- 1. 
Solutions. 


(a) There are critical points at x , = nm, where n is an integer. When n is even, 
xX ,) = 1 > 0, and these critical points are unstable. When n is odd, f(x ,) = -1 < 
n p n 


0, and these critical points are stable. 

(b) There is one critical point at x 9 = 0 and f (x) = 2x in this case. Now f (0) = 
0 and f'(0) = 2 > 0. Therefore, x 9 is attracting when x < 0 and repelling when x > 
0. The critical point is called semistable . 

(c) There is one critical point at x ọ = 0. Now f (0) = —1 < 0, and therefore the 


critical point at the origin is stable. 
The theory of autonomous systems of ODEs in two dimensions will be 
discussed in the next chapter. 


2.5 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


lpprint =| # Pretty print Python data structures. 
[symbols | # Create symbol to namespace, accepts a 
Prange notation. O 


# Program 02a: A simple separable ODE. See Example 
T.. 

from sympy import dsolve, Eq, Function, symbols 

t = symbols(’t’) 

x = symbols(’x’, cls=Function) 

sol = dsolve(Eq(x(t).diff(t), -t/x(t)), x(t)) 

print(sol) 


# Program 02b: The logistic equation. See Example 
3. 

from sympy import dsolve, Eq, Function, symbols 

t = symbols(’t’) 

a = symbols(’a’) 

b=symbols(’b’ ) 

P=symbols(’P’, cls=Function) 

sol=dsolve(Eq(P(t).diff(t), P(t)* 
(a - b * P(t))), P(t)) 

print(sol) 


# Program 02c : Power series solution first order O 
DE. 


# See Example 7. 

from sympy import dsolve, Function, pprint 

from sympy.abc import t 

x = Function(’x’) 

ODE1 = x(t).diff(t) + t*x(t) - t**3 
pprint(dsolve(ODE1, hint=’1ist_power_series’, n=8, i 


cs={x(@):1})) 


# Program 02d : Power series solution of a second o 
rder ODE. 

# See Example 8. 

from sympy import dsolve, Function, pprint 

from sympy.abc import t 

x = Function(’x’ ) 

ODE2 = x(t).diff(t,2) + 2*t**2*x(t).diff(t) + x(t) 

pprint(dsolve(ODE2, hint=’2nd_power_series_ordinary 
", n=6)) 


# Program 02e: Numerical and truncated series solut 
ions. 

# See Figure 2.6. 

from scipy.integrate import odeint 

import matplotlib.pyplot as plt 

import numpy as np 


def ODE2(X, t): 


x = X[O] 
y = X[1] 
dxdt = y 


dydt = x-t**2*y 
return [dxdt, dydt] 


xo = [1, 0] 

t = np.linspace(0, 10, 1000) 
sol = odeint(ODE2, XO, t) 

x = sol[:, 0] 

y = sol[:, 1] 


fig, ax = plt.subplots() 
ax.plot(t,x,label=’Numerical’ ) 


ax.plot(t, 1 + t**2/2 + t**4/24, ‘r-’, label=’Trunc 
ated series’ ) 

plt.xlabel("t", fontsize=15) 

plt.ylabel("x", fontsize=15) 

plt.tick_params(labelsize=15) 

plt.xlim(0, 4) 

plt.ylim(0, 4) 

ax.legend(loc=’lower center’, shadow=True) 

plt.show() 


# Program O2f: A linear first order ODE. 
from sympy import Function, dsolve, Eq, symbols, si 


t 
I 


(t)) 
print(sol) 


symbols(’t’); 
symbols(’I’, cls=Function) 
= dsolve(Eq(I(t).diff(t), 5*sin(t) - I(t)/5), I 


ep) 
ie) 
= Hl I 


# Program 02g: A second order ODE. 
from sympy import symbols, dsolve, Function, Eq, si 


t 
I 


symbols(’t’); 
symbols(’I’, cls=Function) 
= dsolve(Eq(I(t).diff(t,t) + 5*I(t).diff(t) + 6 


= tl tl 


SO 
ATE) 

10*sin(t)),I(t)) 

print(sol) 


2.6 Exercises 


Sketch some solution curves for the following differential equations: 
(a) & ~ _Y. 
Gk xe? 


b) DD. 
(b) 2- 


X 3 


c) DD. 
( ) dx 2x? 
(d) w_y. 

dx x? 
e) DW _ 2. 
( ) dx x24y2? 
Osz 


dx x2" 


Fossils are often dated using the differential equation 
dA 


— = -@A, 
dt 
where A is the amount of radioactive substance remaining, a is a 
constant, and t is measured in years. Assuming that a = 1.5 x 1077, 
determine the age of a fossil containing radioactive substance A if only 
30% of the substance remains. 


Write down the chemical reaction rate equations for the reversible reaction 
equations 

(av A+B+C=D, 

(b)A+A+A=A;3, 

given that the forward rate constant is k ¢ and the reverse rate constant 
is k ,, in each case. Assume that the chemical equations are the rate- 


determining steps. 


(a) Consider a series resistor-inductor circuit with L = 2 H, R= 10 Q and an 
applied EMF of E = 100sin(t). Use an integrating factor to solve the 
differential equation, and find the current in the circuit after 0.2 seconds 
given that [(0) = 0. 

(b) The differential equation used to model a series resistor-capacitor 
circuit is given by 


eee: 


E, 
dt C 


where Q is the charge across the capacitor. If a variable resistance R = 
1⁄5 + t) Q and a capacitance C = 0. 5 F are connected in series with an 


applied EMF, E = 100 V, find the charge on the capacitor given that Q(0) = 
0. 


(a) A forensic scientist is called to the scene of a murder . The temperature 
of the corpse is found to be 75° F and one hour later the temperature has 
dropped to 70° F. If the temperature of the room in which the body was 
discovered is a constant 68° F, how long before the first temperature 
reading was taken did the murder occur? Assume that the body obeys 
Newton’s Law of Cooling , 


where T is the temperature of the corpse, f is a constant, and T p is room 


temperature. 

(b) The differential equation used to model the concentration of 
glucose in the blood, say, g(t), when it is being fed intravenously into the 
body, is given by 


where k is a constant, G is the rate at which glucose is admitted, and V 
is the volume of blood in the body. Solve the differential equation and 
discuss the results. 

(c) Single fiber muscle can be modeled using simple differential 
equations [11]. Download our preprint paper on “Hysteresis in muscle” 
from ResearchGate and use Python to reproduce the results of the Hill 
model given in that paper. 


Show that the series solution of the Airy equation 


where x(0) =a, and x(0) = a), used in physics to model the defraction of 


light, is given by 


10. 


a pr 
x(t) = a í F 2 e) 


RA prt! 


A chemical substance A changes into substance B at a rate a times the 
amount of A present. Substance B changes into C at a rate p times the 
amount of B present. If initially only substance A is present and its amount 
is M, show that the amount of C present at time t is 


pe — “| 


m+f 
œ -p 


Two tanks A and B, each of volume V, are filled with water at time t = 0. 
For t > 0, volume v of solution containing mass m of solute flows into tank 
A per second; mixture flows from tank A to tank B at the same rate; and 
mixture flows away from tank B at the same rate. The differential 
equations used to model this system are given by 
do, v m dog v 
— + -0a ==, — 


r 
nee awa Ny" y 


where o 4 pg are the concentrations of solute in tanks A and B, respectively. 
Show that the mass of solute in tank B is given by 


m (1 — gr) = mie”, 
v 


In an epidemic the rate at which healthy people become infected is a times 
their number, the rates of recovery and death are, respectively, b and c 
times the number of infected people. If initially there are N healthy people 
and no sick people, find the number of deaths up to time t. Is this a realistic 
model? What other factors should be taken into account? 


(a) Determine the maximal interval of existence for each of the following 
initial value problems: 


G) ž = xf, x(0) = 1; 
(i) += Z x(0) =g 


(iii) x = x(x — 2), x(0) = 3. 


(b) For what values of t ọ and x ọ does the initial value problem 


TDN Aig) = 


have a unique solution? 
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3. Planar Systems 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To introduce the theory of planar autonomous linear differential equations. 
e To extend the theory of linear systems to that of nonlinear systems. 


On completion of this chapter, the reader should be able to 


e find and classify critical points in the plane; 

e carry out simple linear transformations; 

e construct phase plane diagrams using nullclines, vector fields, and 
eigenvectors; 

e apply the theory to simple modeling problems. 


Basic analytical methods for solving two-dimensional linear autonomous 
differential equations are reviewed and simple phase portraits are constructed in 
the plane. 

The method of linearization is introduced and both hyperbolic and 
nonhyperbolic critical points are defined. Phase portraits are constructed using 
Hartman’s theorem. The linearization technique used here is based on a linear 
stability analysis. There are many textbooks on planar systems, for example, see 
[1,2,3,4 5,6,7,8, 9]. 


3.1 Canonical Forms 


Consider linear two-dimensional autonomous systems of the form 


(21) 


dx . g 
= = X = A11 X + Aaj), 


ly . 
dt “= y = a21 X + AY, 


dt 


where the a ;j are constants. The system is linear as the terms in x, y, x, and 


y are all linear. System (3.1) can be written in the equivalent matrix form as 


x = Ax, (3.2) 


where x e §R2 and 


Definition 1. Every solution of (3.1) and (3.2), say, O(t) = (x(0), y(t), can be 
represented as a curve in the plane. The solution curves are called trajectories or 
orbits . 


The existence and uniqueness theorem guarantees that trajectories do not cross. 
Note that there are an infinite number of trajectories that would fill the plane if 
they were all plotted. However, the qualitative behavior can be determined by 
plotting just a few of the trajectories given the appropriate number of initial 
conditions. 


Definition 2. The phase portrait is a two-dimensional figure showing how the 
qualitative behavior of system (3.1) is determined as x and y vary with t. 


With the appropriate number of trajectories plotted, it should be possible to 
determine where any trajectory will end up from any given initial condition. 


Definition 3. The direction field or vector field gives the gradients ¢Y and 
dx 


direction vectors of the trajectories in the phase plane. 


The slope of the trajectories can be determined using the chain rule, 
dy B y 
dx x 


and the direction of the vector field is given by x and y at each point in the xy 


plane. 


Definition 4. The contour lines for which 2Y is a constant are called isoclines 
dx 


Definition 5. The contour lines for which = — () and = — (0 are called 
dt adt 


nullclines . 


Isoclines may be used to help with the construction of the phase portrait. For 
example, the nullclines for which x = 0 and y = 0 are used to determine where 


the trajectories have vertical and horizontal tangent lines, respectively. If x = 0, 


then there is no motion horizontally, and trajectories are either stationary or 
move vertically. A similar argument is used when y = 0. 


Using linear algebra, the phase portrait of any linear system of the form (3.2) 
can be transformed to a so-called canonical form y = Jy by applying a 


transformation x = P y, where P is to be determined and J = P 7t AP is of one of 
the following forms: 
A, 0 
nsl o h=| f P ; 
0 A> -p Q 


nal 2). aed) 
0 4 0 A; 

where A ; 2, a, P, and p are real constants. Matrix J ; has two real distinct 
eigenvalues, matrix J » has complex eigenvalues, and matrices J 3 and J 4 have 
repeated eigenvalues. The qualitative type of phase portrait is determined from 
each of these canonical forms. 

Nonsimple Canonical Systems 

The linear system (3.2) is nonsimple if the matrix A is singular (i.e., det(A) = 


0, and at least one of the eigenvalues is zero). The system then has critical points 
other than the origin. 


Example 1. Sketch a phase portrait of the system x = x, ý = 0. 


Solution. The critical points are found by solving the equations x = y = 0, 


which has the solution x = 0. Thus there are an infinite number of critical points 
lying along the y-axis. The direction field has gradient given by 


dy ý 0 

a = z =-= 0 

dx + x 
for x # 0. This implies that the direction field is horizontal for points not on the 
y-axis. The direction vectors may be determined from the equation x = x since 
if x > 0, then x > O, and the trajectories move from left to right; and if x < 0, 
then x < 0, and trajectories move from right to left. A phase portrait is plotted 


in Figure 3.1. 
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Figure 3.1 Six trajectories and a vector field plot for Example 1. Note that there are an infinite number of 
critical points lying on the y-axis. The vector field is also plotted. 


Simple Canonical Systems 

System (3.2) is simple if det(A) # 0, and the origin is then the only critical 
point. The critical points may be classified depending upon the type of 
eigenvalues. 


3.1.1 Real Distinct Eigenvalues 
Suppose that system (3.2) can be diagonalized to obtain 


= A,X, y = Any. 
The solutions to this system are y(7) = C,e*!! and y(t) = Cye2', where C , and 
C 5 are constant. The solution curves may be found by solving the differential 
equation given by 
dy _y_ Ay 
dx x Ax 


which is integrable. The solution curves are given by |y|41 = K|x|42. The type of 


phase portrait depends on the values of A , and A 5, as summarized below: 


e Ifthe eigenvalues are distinct, real, and positive, then the critical point is 
called an unstable node . 

e Ifthe eigenvalues are distinct, real, and negative, then the critical point is 
called a stable node . 

e If one eigenvalue is positive and the other negative, then the critical point is 
called a saddle point or col . 


Possible phase portraits for these canonical systems along with vector fields 
superimposed are shown in Figure 3.2. 
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Figure 3.2 Possible phase portraits for canonical systems with two real distinct eigenvalues: (a) unstable 
node; (b) stable node; (c) saddle point or col. 


3.1.2 Complex Eigenvalues (A = a + if) 


Consider a canonical system of the form 
žx=&@x+ßy, Yeo +y. (3.3) 


Convert to polar coordinates by making the transformations x = rcos@ and y 
= rsin. Then elementary calculus gives 


re=xk+yy, r= x- yi. 
System (3.3) becomes 
=ar, @=-£. 
The type of phase portrait depends on the values of a and £: 


If a > 0, then the critical point is called an unstable focus . 

If a = 0, then the critical point is called a center . 

If a < 0, then the critical point is called a stable focus . 

If ġ > 0, then the trajectories spiral counterclockwise around the origin. 


e If ġ < 0, then the trajectories spiral clockwise around the origin. 


Phase portraits of the canonical systems with the vector fields superimposed are 
shown in Figure 3.3. 
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Figure 3.3 Possible phase portraits for canonical systems with complex eigenvalues: (a) unstable focus; 
(b) stable focus; (c) center. 


3.1.3 Repeated Real Eigenvalues 
Suppose that the canonical matrices are of the form J 3 or J 4. The type of phase 
portrait is determined by the following: 


e If there are two linearly independent eigenvectors (see Section 3.2), then the 
critical point is called a singular node . 

e If there is one linearly independent eigenvector, then the critical point is called 
a degenerate node . 


Possible phase portraits with vector fields superimposed are shown in 
Figure 3.4. 
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Figure 3.4 Possible phase portraits for canonical systems with repeated eigenvalues: (a) an unstable 
singular node; (b) an unstable degenerate node. 


The classifications given in this section may be summarized using the trace 
and determinant of the matrix A as defined in system (3.2). If the eigenvalues are 


À 1,2, then the characteristic equation is given by (A -À ;)(A -À 9) =A 2 Nig eA 
yA +A 1A > =A? -trace(A)A + det(A) = 0. Therefore, 


_ trace(A) + y(trace(A))* — 4det(A) 


Ai 2 — eS ; 


The summary is depicted in Figure 3.5. 
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Figure 3.5 Classification of critical points for system (3.2). The parabola has equation T 2_4n= 0, 
where D = det(A) and T = trace(A). 


3.2 Eigenvectors Defining Stable and Unstable 
Manifolds 


Consider Figure 3.5. Apart from the region T * — 4D < 0, where the trajectories 
spiral, the phase portraits of the canonical forms of (3.2) all contain straight line 
trajectories that remain on the coordinate axes forever and exhibit exponential 
growth or decay along it. These special trajectories are determined by the 
eigenvectors of the matrix A and are called the manifolds . If the trajectories 
move towards the critical point at the origin as t > © along the axis, then there 
is exponential decay and the axis is called a stable manifold. If trajectories move 
away from the critical point as t > œ, then the axis is called an unstable 
manifold. 

In the general case, the manifolds do not lie along the axes. Suppose that a 
trajectory is of the form 


x(t) = exp(pe, 


where e ~ 0 is a vector and J is a constant. This trajectory satisfies equation 


(3.2) since it is a solution curve. Therefore, substituting into (3.2), 
Aexp(Atje = exp(4t)Ae 
or 


Ae = Ae. 


From elementary linear algebra, if there exists a nonzero column vector e 
satisfying this equation, then A is called an eigenvalue of A and e is called an 
eigenvector of A corresponding to the eigenvalue A. If A is negative, then the 
corresponding eigenvector gives the direction of the stable manifold, and if A is 
positive, then the eigenvector gives the direction of the unstable manifold. 
When A , 4A 5, it is known from elementary linear algebra that the eigenvectors 


e , and e 5, corresponding to the eigenvalues A ; and J 5, are linearly independent. 


Therefore, the general solution to the differential equations given by (3.1) is 
given by 


x(t) = Cı exp(A Hey + Co exp(at eo, 


where C 4, C » are constants. In fact, for any given initial condition, this solution 
is unique by the existence and uniqueness theorem. 


Definition 6. Suppose that () e %2? is a critical point of the linear system 


(3.2). Then the stable and unstable manifolds of the critical point 0 are denoted 
by E (0) and E ,,(0), respectively, and are determined by the eigenvectors of the 


critical point at 0. 
Consider the following two simple illustrations. 


Example 2. 
Determine the stable and unstable manifolds for the linear system 


S287), ýy=x+2y. 
Solution. The system can be written as X = Ax, where 
2 I 
A= | | 
12 


The characteristic equation for matrix A is given by det(A —AI) = 0, or in this 


case, 


Therefore, the characteristic equation is A * — 4A + 3 = 0, which has roots A į} = 1 
and A 5 = 3. Since both eigenvalues are real and positive, the critical point at the 
origin is an unstable node. The manifolds are determined from the eigenvectors 
corresponding to these eigenvalues. The eigenvector for A 4 is e 4 = (1, -1)? and 
the eigenvector for A 5 is e » = (1, 1)’, where T represents the transpose matrix. 
The manifolds are shown in Figure 3.6. 


Figure 3.6 The two unstable manifolds, defined by the eigenvectors e q and e 9, for Example 2. 


For the sake of completeness, the general solution in this case is given by 


x(t) = Ci exp(f)(1, -—1)’ + Cr exp(3n(1, 1)’. 
Example 3. | Determine the stable and unstable manifolds for the linear system 


i= oa 
~“t=—2 37° 


Solution. The characteristic equation for matrix A is given by 


Therefore, the characteristic equation is A ° — 1 = 0, which has roots A į = 1 and A 
> = —1. Since one eigenvalue is real and positive and the other is real and 
negative, the critical point at the origin is a saddle point. The manifolds are 
derived from the eigenvectors corresponding to these eigenvalues. The 
eigenvector for A , is (1, 1)? and the eigenvector for A 5 is (2, 1)’. The manifolds 


are shown in Figure 3.7. 
For the sake of completeness, the general solution in this case is given by 


x(t) = Ci exp(f)(1, 1)’ + C2 exp(—)(2, 1)’. 


Notation. The stable and unstable manifolds of linear systems will be 
denoted by E s and E y, respectively. Center manifolds (where the eigenvalues 


have zero real part) will be discussed in Chapter 8 


Figure 3.7 The stable and unstable manifolds for Example 3. The trajectories lying on the stable manifold 
tend to the origin as t > oo but never reach it. 


3.3 Phase Portraits of Linear Systems in the Plane 


Definition 7. Two systems of first-order autonomous differential equations 
are said to be qualitatively (or topologically ) equivalent if there exists an 
invertible mapping that maps one phase portrait onto the other while preserving 
the orientation of the trajectories. 


Phase portraits can be constructed using nullclines, vector fields, and 


eigenvectors (for real eigenvalues). 


Example 4. Consider the system 


(21 
smj oe 


Find (a) the eigenvalues and corresponding eigenvectors of A; (b) a 
nonsingular matrix P such that J = P “t AP is diagonal; (c) new coordinates (u, v) 
such that substituting x = x(u, v), y = y(u, v), converts the linear dynamical 
system 


K=2x+y, ýy=x+2y, into ù=Au, V= Av 
for suitable A ,, A 5; (d) sketch phase portraits for these qualitatively equivalent 


systems. 


Solutions The origin is a unique critical point. 

(a) From Example 2, the eigenvalues and corresponding eigenvectors are 
given by A, = 1, (1, —1)f and å , = 3, (1, 1)/; the critical point is an unstable 
node. 

(b) Using elementary linear algebra, the columns of matrix P are these 
eigenvectors and so 


and 


I Q 
JaP AP = 
(o3) 
(c) Take the linear transformation x = P u to obtain the system ù = u, 
v = 3v. 


(d) Consider the nullclines. In the xy plane, the flow is horizontal on the line 
where y = 0 and hence on the line y = —wx2. On this line, x = 3x/2; thus x > 0 


ifx >Oand x < 0 if x < 0. The flow is vertical on the line y = —2x. On this line, 


y <Oifx>Oand py > Oifx<0. 
Vector fields: The directions of the vector fields can be determined from x 
and y at points (x, y) in the plane. 


Consider the slope of the trajectories. If x + 2y > 0 and 2x + y > 0, then 
dy ~ Q; ifx + 2y < 0 and 2x + y > 0, then a ' < 0} if x + 2y > 0 and 2x + y < 0, 


dx 


then dy < gjandifx+ 2y <0 and 2x +y < 0, then OEN 


Manifolds: From the eigenvectors, both manifolds are unstable. One passes 
through (0, 0) and (1, 1) and the other through (0, 0) and (1, -1). 

Putting all of this information together gives the phase portrait in 
Figure 3.8(a). The canonical phase portrait is shown in Figure 3.8(b). 
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Figure 3.8 [Python] Qualitatively equivalent phase portraits for Example 4. 


Example 5. Sketch a phase portrait for the system 
LE), ý=xX-Yy. 
Solution. The origin is the only critical point. The characteristic equation is 
given by 
A — Al] =? +24+2=0, 


which has complex solutions À 4 5 = —1 + i. The critical point at the origin is a 
stable focus. 


Consider the nullclines. In the xy plane, the flow is horizontal on the line 
where y = 0 and hence on the line y = x. On this line, x = —2x; thus x < 0 if x 


>Oand x > 0 if x < 0. The flow is vertical on the line where x = 0 and hence 
on the line y = —x. On this line ý < 0 if x > 0 and ý > Oifx<0O. 

Vector fields: The directions of the vector fields can be determined from x 
and y at points (x, y) in the plane. 


Consider the slope of the trajectories. If y > x and y > —x, then a > 03 ify > 
ax 
x and y < —x, then a < 0; ify <x and y > ~x, then a < 0; adify <x and y < 
ax ax 


—x, then td > 0: 
dx 
Manifolds: The eigenvectors are complex and there are no real manifolds. 
Converting to polar coordinates gives j = —;,@ = |. Putting all of this 


information together gives the phase portrait in Figure 3.9. 
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Figure 3.9 Some trajectories for Example 5. The critical point is a stable focus. 
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Figure 3.10 Some trajectories for Example 6. The critical point is a stable degenerate node. 


Example 6. 
Sketch a phase portrait for the system 


X=-2x, y= -—4x—-2y. 


Solution. The origin is the only critical point. The characteristic equation is 
given by 


IA — Al] = A*-424+4=0, 


which has repeated roots A ; 9 = —2. 


Consider the nullclines. In the xy plane, the flow is horizontal on the line where 
y = 0 and hence on the line y = —2x. Trajectories which start on the y-axis 


remain there forever. 
Vector fields: The directions of the vector fields can be determined from x 


and y at points (x, y) in the plane. 
Consider the slope of the trajectories. The slopes are given by = at each 
ax 
point (x, y) in the plane. 


Manifolds: There is one linearly independent eigenvector, (0, 1)’. Therefore, 
the critical point is a stable degenerate node. The stable manifold E ș is the y- 


axis. 


Putting all of this together gives the phase portrait in Figure 3.10. 

Phase portraits of nonlinear planar autonomous systems will be considered in 
the following sections, where stable and unstable manifolds do not necessarily 
lie on straight lines. However, all is not lost as the manifolds for certain critical 
points are tangent to the eigenvectors of the linearized system at that point. 

Manifolds in three-dimensional systems will be discussed in Chapter 14 


3.4 Linearization and Hartman’s Theorem 
Suppose that the nonlinear autonomous system 
X= P(x,y), y= Q(x,y) (3.4) 


has a critical point at (u, v), where P and Q are at least quadratic in x and y. 
Take a linear transformation which moves the critical point to the origin. Let X = 
x-— uand Y= y - v. Then system (3.4) becomes 


X=P(X+u,¥+v)=Pluv)+ XP] _ at ye + R(X, Y) 
XIX=U,V=V oy X=U,V=V 

Y= Q(X +u, Y +v) = Qu, v) + X2] + YF + S(X,Y) 
A IXSU,y=V oy x=u,y=Vv 


after a Taylor series expansion . The nonlinear terms R and S satisfy the 
conditions x — 0 and > > 0 as -= yX? + y2 — 0: The functions R and S 


are said to be “big Oh of r ?,” or in mathematical notation, R = O(r °) and S = 
O(r °). Discard the nonlinear terms in the system and note that P(u, v) = Q(u, v) = 
0 since (u, v) is a critical point of system (3.4). The linearized system is then of 
the form 


>_ ydP aP 
x ~ Ox xX=uU,y=Vv Oy X=u.v=v 

oe (3.5) 
7 — yö ag 
y a Xo X=U,V=V oy X=U,y=V 


and the Jacobian matrix is given by 


OP OP 

-_ Ox ay 

J(u,v) = 50 50 
Ox Oy 


X=U,Y=V 


Definition 8. A critical point is called hyperbolic if the real part of the 
eigenvalues of the Jacobian matrix J(u, v) is nonzero. If the real part of either of 
the eigenvalues of the Jacobian is equal to zero, then the critical point is called 
nonhyperbolic . 


Hartman’s Theorem . Suppose that (u,v) is a hyperbolic critical point of system 
(3.4 ). Then there is a neighborhood of this critical point on which the phase 
portrait for the nonlinear system resembles that of the linearized system (3.5 ). 
In other words, there is a curvilinear continuous change of coordinates taking 
one phase portrait to the other, and in a small region around the critical point, 
the portraits are qualitatively equivalent. 

A proof to this theorem may be found in Hartman’s book [2]. Note that the 
stable and unstable manifolds of the nonlinear system will be tangent to the 
manifolds of the linearized system near the relevant critical point. These 
trajectories diverge as one moves away from the critical point; this is illustrated 
in Examples 7 and 8. 

Notation. Stable and unstable manifolds of a nonlinear system are labeled W 
s and W y, respectively. 

Hartman’s theorem implies that W s and W y are tangent to E < and E y at the 


relevant critical point. If any of the critical points are nonhyperbolic, then other 
methods must be used to sketch a phase portrait, and numerical solvers may be 
required. 


3.5 Constructing Phase Plane Diagrams 


The method for plotting phase portraits for nonlinear planar systems having 
hyperbolic critical points may be broken down into three distinct steps: 


e Locate all of the critical points. 
e Linearize and classify each critical point according to Hartman’s theorem. 
e Determine the nullclines and use 2y to obtain slopes of trajectories. 


dx 


The method can be illustrated with some simple examples. Examples 10—12 
illustrate possible approaches when a critical point is not hyperbolic. 


Example 7. 
Sketch a phase portrait for the nonlinear system 


S=x%; yr ty el: 


Solution. Locate the critical points by solving the equations x = y = 0. Hence 
x= Oifx=Oand ý= 0 ifx?+y?=1.Ifx=0, then ý= Oify?= 1, which 


has solutions y = 1 and y = —1. Therefore, there are two critical points, (0, 1) and 
(0, -1). 
Linearize by finding the Jacobian matrix; hence 


OP OP 
J= Be. Orda ob A. 
ee el Das: Dag ye 


Ox ody 


Linearize at each critical point; hence 


The matrix is in diagonal form. There are two distinct positive eigenvalues 
and hence the critical point is an unstable node. 
For the other critical point, 


1 0 
Jo-1) = 0 2 j 


There is one positive and one negative eigenvalue, and so this critical point is 
a saddle point or col. 

Note that the matrices J (9 1) and J (9 _1) are in diagonal form. The 
eigenvectors for both critical points are (1, 0)! and (0, 1)". Thus in a small 
neighborhood around each critical point, the stable and unstable manifolds are 
tangent to the lines generated by the eigenvectors through each critical point. 
Therefore, near each critical point the manifolds are horizontal and vertical. Note 
that the manifolds of the nonlinear system W s and W y need not be straight lines 
but are tangent to E < and E y at the relevant critical point. 

Consider the nullclines. Now + = 0 on x = 0, and on this line j = y? — 1. 


Thus if | y | < 1, then y < 0, and if | y | > 1, then ý > 0. Also, ý = 0 onthe 


circle x°? + y? = 1, and on this curve x = x. Thus if x > 0, then x > 0, and if x < 
0, then x < 0. The slope of the trajectories is given by 

dy _ xX +y -|l 

dx x 


Putting all of this information together gives a phase portrait as depicted in 
Figure 3.11. 
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Figure 3.11 A phase portrait for Example 7. The stable and unstable manifolds (W s, W yy) are tangent to 
horizontal or vertical lines (E s, E [j) ina small neighborhood of each critical point. 


Example 8. 
Sketch a phase portrait for the nonlinear system 


kay, p=x1—-2x’)+y. 


Solution. Locate the critical points by solving the equations x = y = 0. Hence 
x= Oify=Oand ý= O ifx(1-x7)+y=0.Ify=0, then y = Oifx(1-x2)= 


0, which has solutions x = 0, x = 1, and x = —1. Therefore, there are three critical 
points, (0, 0), (1, 0), and (-1, 0). 
Linearize by finding the Jacobian matrix; hence 


OP OP 
Je ax ð | _ 0 l 
ce 1-3x7 1j 


ôx oy 


Linearize at each critical point; hence 


0 1 
Joo = | E ) 


The eigenvalues are 


The corresponding eigenvectors are (| ),)/ and ({ ,,)/. Thus the critical 


point at the origin is a saddle point or col. 
For the other critical points, 


0 | 
Jaw = J(-1.0) = | 7 | | 


The eigenvalues are 


and so both critical points are unstable foci. 
Consider the nullclines. Now x = 0 on y = 0, and on this line, 


y= — x*). Thus if 0 < x < 1, then y > 0; if x> 1, then y < 0;if-1<x< 


0, then ý < 0, and if x < -1, then ý > 0. Also, ý = 0 on the curve y = x - x3, 


and on this curve, x = y. Thus if y > 0, then x > 0, and if y < 0, then x < 0. 
The slope of the trajectories is given by 

dy... x+y 

dx y 


Note that on x = 0 and x = +1, “& — 1. Putting all of this information together 
dx 


gives a phase portrait as depicted in Figure 3.12. 


Example 9. 
Plot a phase portrait for the system 


x=x(1-%-y), y=y(x-1-3). 


Solution. Locate the critical points by solving the equations x = y = 0. Hence 
x = 0 if either x = 0 or y = | — 5. Suppose that x = 0. Then y = 0 if 


y (-1 _ z) — @ Which has solutions y = 0 or y = —2. Suppose that y = | — 5. 


Then y = 0 if either | — 5 -Qorl-—- a = 2x — 2, which has solutions x = 2 or 


x= £. Thus there are four critical points at (0,0), (2,0), (0,-2), and (£ 2 i 
: 5? 5 


Notice that x = 0 when x = 0, which means that the flow is vertical on the y- 
axis. Similarly, ý = 0 when y = 0, and the flow is horizontal along the x-axis. In 


this case, the axes are invariant . A Python program for locating the critical 
points is listed in Section 3.6. 


Figure 3.12 [Python] A phase portrait for Example 8. Note that, in a small neighborhood of the origin, the 
unstable manifold (W y) is tangent to the line E y given by y =A 1 x, and the stable manifold (W s) is 


tangent to the line E s given by y = À 9x. 


Linearize by finding the Jacobian matrix; hence 
OP OP 1 À 
Tù 22 R |7 =i 
Ox y y a l y 


Linearize around each of the critical points and apply Hartman’s theorem. 
Consider the critical point at (0,0). The eigenvalues are A = +1 and the critical 
point is a saddle point or col. Next, consider the critical point at (2,0); now the 
eigenvalues are A , = 1 and à , = —1. The corresponding eigenvectors are (—1, 1)? 


and (1, 0), respectively. This critical point is also a saddle point or col. Consider 
the critical point at (0,-2). Now the eigenvalues are A į = 3 and À 5 = 1; the 


corresponding eigenvectors are (1, -1)! and (0, 1)’, respectively. The critical 
point at (0, —2) is therefore an unstable node. Finally, consider the critical point 
at ( 6 2 ): The eigenvalues in this case are 

5? 5 


_-24iVvil 


A 
5 


and the critical point is a stable focus. There is no need to find the eigenvectors; 
they are complex in this case. 
Consider the nullclines. Now x = 0 onx=0 oron y= | — 5, and ý = 0 on 


y = 0 or on y = 2x - 2. The directions of the flow can be found by considering y 
and x on these curves. 
The slope of the trajectories is given by 
a_l- 


A phase portrait indicating the stable and unstable manifolds of the critical 
points is shown in Figure 3.13. 
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Figure 3.13 A phase portrait for Example 9. The axes are invariant. 


Example 10. 
Sketch a phase portrait for the nonlinear system 


Solution. Locate the critical points by solving the equations x = y = 0. 


Therefore, x = 0 if y = 0 and y = Q if x = 0. Thus the origin is the only critical 


point. 
Attempt to linearize by finding the Jacobian matrix; hence 


OP OP 


{2 BI" \1 0 


Ox oy 


Linearize at the origin to obtain 


The origin is a nonhyberbolic critical point. To sketch a phase portrait, solve 
the differential equation 


Tal 


x 

dx x y” 

using the method of separation of variables highlighted in the previous chapter. 
Consider the nullclines. Now x = 0 ony = 0, and on this line ý = x. Thus if 


x > 0, then y > 0, and if x < 0, then y < 0. Also, ý = 0 on x = 0, and on this 
line ý = y?. Thus x > 0 for all y. The slope of the trajectories is given by 


dy T 26 
dx — y2 


. Putting all of this information together gives a phase portrait as 


depicted in Figure 3.14. 
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Figure 3.14 A phase portrait for Example 10 that has a nonhyperbolic critical point at the origin. There is 
a cusp at the origin. 


Example 11. 
A simple model for the spread of an epidemic in a city is given by 


S=-tSI, l=rSI-rI, 


where S(t) and I(t) represent the numbers of susceptible and infected individuals 
scaled by 1000, respectively; t is a constant measuring how quickly the disease 
is transmitted; r measures the rate of recovery (assume that those who recover 
become immune); and t is measured in days. Determine a value for S at which 
the infected population is a maximum. 


Given that t = 0. 003 and r = 0. 5, sketch a phase portrait showing three 
trajectories whose initial points are at (1000, 1), (700, 1), and (500, 1). Give a 
physical interpretation in each case. 


Solution. The maximum number of infected individuals occurs when uh —(). 
a 


Now 


dI İİ qtS-r 


ds $ -TS 


Therefore, 4L — Q when § = +. The number + is called the threshold value . 


dS ~ 


The critical points for this system are found by solving the equations 
$ = Ï = 0. Therefore, there are an infinite number of critical points lying along 


the horizontal axis. A phase portrait is plotted in Figure 3.15. 
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Figure 3.15 A phase portrait showing three trajectories for Example 11. The axes are scaled by 10? in 
each case. Trajectories are only plotted in the first quadrant since populations cannot be negative. 


In each case, the population of susceptibles decreases to a constant value and 
the population of infected individuals increases and then decreases to zero. Note 
that in each case, the maximum number of infected individuals occurs at 


S = +4 167,000. 


r 
T 
Example 12. 

Chemical kinetics involving the derivation of one differential equation were 
introduced in Chapter 8 This example will consider a system of two differential 
equations. Consider the isothermal chemical reaction 


A+B=C, 


in which one molecule of A combines with one molecule of B to form one 
molecule of C. In the reverse reaction, one molecule of C returns to A + B. 
Suppose that the rate of the forward reaction is k pand the rate of the backward 
reaction is k ,. Let the concentrations of A, B, and C be a, b, and c, respectively. 
Assume that the concentration of A is much larger than the concentrations of B 
and C and can therefore be thought of as constant. From the law of mass action, 
the equations for the kinetics of b and c are 


b=k,.c—kyab, ¢=kyab-k,c. 


Find the critical points and sketch a typical trajectory for this system. Interpret 
the results in physical terms. 
Solution. The critical points are found by determining where b = è = (). 


Clearly, there are an infinite number of critical points along the line mem kja p 
= 5-1 
The slope of the trajectories is given by 
dc ¢ 


db b 
If ee Hp then < 0 and ¢ > 0. Similarly, if oe Ap then ġ > 0 and 


ċ¢ < 0. Two typical solution curves are plotted in Figure 3.16. 
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Figure 3.16 Two solution curves for the chemical kinetic equation in Example 12, where a is assumed to 
be constant. The dotted line represents the critical points lying on the line 22 kpa 


70 


Thus the final concentrations of B and C depend upon the initial concentrations 
of these chemicals. Two trajectories starting from the initial points at (b 9, 0) and 
(b 9, € o) are plotted in Figure 3.16. Note that the chemical reaction obeys the law 


of conservation of mass ; this explains why the trajectories lie along the lines b + 
c = constant. 


Example 13. 

Suppose that H is a population of healthy rabbits and J is the sub-population of 
infected rabbits that never recover once infected, both measured in millions. The 
following differential equations can be used to model the dynamics of the 
system: 


H=(b-dH-6I, l= thH-1D)-(6+a01, 


where b is the birth rate, d is the natural death rate, ô is the rate of death of the 
diseased rabbits, and t is the rate at which the disease is transmitted. 


Given that b = 4, d= 1, 6=6, and t= 1 and given an initial population of (H ọ, I 
o) = (2, 2), plot a phase portrait and explain what happens to the rabbits in real- 
world terms. 

Solution. There are two critical points in the first quadrant at 0 = (0, 0) and P 
= (14, 7). The Jacobian matrix is given by 


z (b - d) —ô 


i Tl tH-2tIl-(6+d)} 


The critical point at the origin is a col with eigenvalues and corresponding 
eigenvectors given by A , = 3, (1, 0)! and å 5 = -7, (3, 5)". The critical point at P 
= (14, 7) has eigenvalues } — —2 + ; +/]7, and is therefore a stable focus. A 


phase portrait is plotted in Figure 3.17. Either the population of rabbits stabilizes 
to the values at P or they become extinct, depending on the initial populations. 
For example, plot a solution curve for the trajectory starting at (H 9, I 9) = (7, 14). 


Models of interacting species will be considered in Chapter 4 


3.6 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


Inp.mgrid  |# Create a grid of (x,y) coordinates. 


[sm.solve  |# Sympy solve command. 
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Figure 3.17 A trajectory starting from the initial point (2, 2). The population stabilizes to 14 million 
healthy rabbits and 7 million infected rabbits. 


# Program 03a: Linear systems in the plane. See Fig 
ure 3.8(a). 

# Phase portrait with vector field. Check two syste 
ms are the same. 

import matplotlib.pyplot as plt 

import numpy as np 

from scipy.integrate import odeint 

import pylab as pl 


# The 2-dimensional linear system. 
a, b, c, d = 2, 1, 1, 2 
def dx_dt(x, t): 
return [a*x[0] + b*x[1], c*x[0] + d*x[1]] 


# Trajectories in forward time. 
ts = np.linspace(0, 4, 100) 
ic = np.linspace(-1, 1, 5) 
for r in ic: 
for s in ic: 
xO = [r, s] 


xs = odeint(dx_dt, x0, ts) 
plt.plot(xs[:,0], xs[:,1], "r-") 


# Trajectories in backward time. 

ts = np.linspace(0, -4, 100) 

ic = np.linspace(-1, 1, 5) 

for r in ic: 

for s in ic: 

xO = [r, s] 
xs = odeint(dx_dt, x0, ts) 
plt.plot(xs[:,0], xs[:,1], "r-") 


# Label the axes and set fontsizes. 
plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.xlim(-1, 1) 

plt.ylim(-1, 1); 


# Plot the vectorfield. 

X,Y = np.mgrid[-1:1:10j, -1:1:10j] 
u = a*X + b*Y 

v = c*X + d*yY 

pl.quiver(X, Y, u, v, color = ’'b’) 
plt.show() 


# Program 03b: Nonlinear system, phase portrait wit 
h vector plot. 

# See Figure 3.12. 

import matplotlib.pyplot as plt 

import numpy as np 

from scipy.integrate import odeint 

import pylab as pl 

# The 2-dimensional nonlinear system. 

def dx_dt(x, t): 

return [x[1], x[0] (1 - x[0]*2) + x[1]] 


# Trajectories in forward time. 


ts np.linspace(0, 10, 500) 
ic np.linspace(-3, 3, 6) 
for r in ic: 
for s in ic: 
xO = [r, s] 
xs = odeint(dx_dt, x0, ts) 
plt.plot(xs[:,0], xs[:,1], 


# Trajectories in backward time. 
ts = np.linspace(0, -10, 500) 
ic = np.linspace(-3, 3, 6) 
for r in ic: 
for s in ic: 
xO = [r, s] 
xs = odeint(dx_dt, x0, ts) 
plt.plot(xs[:,0], xs[:,1], 


# Label the axes and set fontsizes. 


plt.xlabel("x", fontsize=15) 
plt.ylabel("y", fontsize=15) 
plt.tick_params(labelsize=15) 
plt.xlim(-3, 3) 
plt.ylim(-3, 3); 


# Plot the vectorfield. 


X, Y = np.mgrid[-3:3:20j, -3:3:20j] 


u=Y 

v=X (1 - X*2)+Y 

pl.quiver(X, Y, u, v, color = 'b’) 
plt.show() 


"r-") 


"r-") 


# Program 03c: Finding critical points. 


# See Example 9. 
import sympy as sm 


, y = sm.symbols(’x, y’) 
x * (1 - x/2 - y) 
YO Se y/2) 


OU X 


# Set P(x,y)=0 and Q(x,y)=0. 

Peqn = sm.Eq(P, 0) 

Qeqn = sm.Eq(Q, 0) 

Criticalpoints = sm.solve((Peqn, Qeqn), x, y) 
print(criticalpoints) 


3.7 Exercises 
1. 


(a) 

Find the eigenvalues and eigenvectors of the matrix 

-7 6 
B= l 
[2 5) 
Sketch a phase portrait for the system x = 6x and its 

corresponding canonical form. 
(b) 

Carry out the same procedures as in part (a) for the system 

ž = -4x - 8y, ý= -2y. 
2. 

Sketch phase portraits for the following linear systems: 
@) 

x= Oy, ý=x+2y; 
(b) 

žx=x+2y, ýy=0; 
OE l 

X= 3x+4y, ý=4x-3y; 
(d) l 

x= 3x+y, ý=-x+3y; 
(e) 

vay Yo-x—2y; 
(f) 


A very simple mechanical oscillator can be modeled using the second-order 
differential equation 


Am de 
— +u— + 25x = 0, 
de dt 
where x measures displacement from equilibrium. 
(a) hte l eee roe 
Rewrite this equation as a linear first order system by setting x = y. 
(b) l g n v 
Sketch phase portraits when (i) p = -8, (ii) p = 0, (iii) p = 8, and (iii) p 
= 26. 
(c) 


Describe the dynamical behavior in each case given that x(0) = 1 and 
x(O) = 0. 


Plot the corresponding solutions in the tx plane. 


Plot phase portraits for the following systems: 


(a) 

x=, ypex-ytr; 
b) 

xX=-2x-—y+2, y= xy; 
© 

tes =y, y=xyv-1; 
(d) 

R=2-x-y’*, po-yo? +y -3x+1); 
(e) 

ya y, y = x2: 
(f) 

x= x’, y = y*: 
(g) 


(h) 
ž =x, ý = u — y» for u < 0, p = 0, and p > 0. 


Construct a nonlinear system that has four critical points: two saddle points, 
one stable focus, and one unstable focus. 


A nonlinear capacitor-resistor electrical circuit can be modeled using the 
differential equations 


ž=y, ý=-x+ X — (d) + ny, 


Pi 


where a 9 is a nonzero constant and x(t) represents the current in the circuit 
at time t. Sketch phase portraits when a ọ > 0 and a ọ < 0 and give a physical 
interpretation of the results. 


An age-dependent population can be modeled by the differential equations 
p=B+ pla—bp), B=B(ct(a-bp)), 


where p is the population, f is the birth rate, and a, b, and c are all positive 
constants. Find the critical points of this system and determine the long-term 
solution. 

. The power , say, P, generated by a water wheel of velocity V can be 
modeled by the system 


P=-aP+PV, V=1-BV-P’, 


where a and f are both positive. Describe the qualitative behavior of this 
system as a and f vary and give physical interpretations of the results. 


A very simple model for the economy is given by 


İ=I-KS, S =I1-CS -6Go, 


where I represents income, S is the rate of spending, G , denotes constant 
government spending, and C and K are positive constants. 


(a) 


Plot possible solution curves when C = 1 and interpret the solutions in 
economic terms. What happens when C # 1? 


(b) 
Plot the solution curve when K = 4, C = 2, G ọ = 4, I(0) = 15, and S(0) 
= 5. What happens for other initial conditions? 
10. 
Given that 
dn ~ UN 
d? ‘dr? 
and 
dr dn 2 
x= it (2) and t = lo a 
T nl e = 08 Ve? 
dr? dr? 
prove that 
ž=x(l+x+y) yýy=y2+x-y). 
Plot a phase portrait in the xy plane. 
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4. Interacting Species 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 
e To apply the theory of planar systems to modeling interacting species. 
On completion of this chapter, the reader should be able to 


° plot solution curves to modeling problems for planar systems; 
° interpret the results in terms of species behavior. 


The theory of planar ODEs is applied to the study of interacting species. The 
models are restricted in that only two species are considered and external factors 
such as pollution, environment, refuge, age classes, and other species 
interactions, for example, are ignored. However, even these restricted systems 
give useful results. These simple models can be applied to species living in our 
oceans and to both animal and insect populations on land. Note that the 
continuous differential equations used in this chapter are only relevant if the 
species populations under consideration are large, typically scaled by 104, 10°, 
or 10° in applications. 

A host-parasite system is presented subject to different types of predation by 
a predator species. 


4.1 Competing Species 


Suppose that there are two species in competition with one another in an 
environment where the common food supply is limited. For example, sea lions 


and penguins , red and gray squirrels , and ants and termites are all species 
which fall into this category. There are two particular types of outcome that are 
often observed in the real world. In the first case, there is coexistence , in which 
the two species live in harmony. (In nature, this is the most likely outcome; 
otherwise, one of the species would be extinct.) In the second case, there is 
mutual exclusion , in which one of the species becomes extinct . (For example, 
American gray squirrels imported into the United Kingdom are causing the 
extinction of the smaller native red squirrels.) Both coexistence and mutual 
exclusion can be observed when plotting solution curves on a phase plane 
diagram. Consider the following general model for two competing species. 


Example 1. Sketch possible phase plane diagrams for the following system: 


x=xP-—déx-vyy), y= y(b -— dy- cx), (4.1) 


where f, 6, y, a, b, and c are all positive constants with x(t) and y(t)—both 
positive—representing the two species populations measured in tens or hundreds 
of thousands. 

Solution. The terms appearing in the right-hand sides of equation (4.1) have 
a physical meaning as follows: 


e The terms Bx —5x * and by — dy ? represent the usual logistic growth of one 
species (Verhulst’s equation) . 

e Both species suffer as a result of competition over a limited food supply, 
hence the terms -yxy and — cxy in x and y. 


Construct a phase plane diagram in the usual way. Find the critical points, 
linearize around each one, determine the nullclines, and plot the phase plane 
portrait. 

Locate the critical points by solving the equations x = ý = 0. There are four 


critical points at 


5 lo? 2 _ (xb -Ba Be- ôb 
O = (0,0), p=(0 ). o = (Ż.0), and a= (Poe a"). 


Suppose that C , = yc —dd, C 5 = yb —Bd, and C 3 = Bc —6b. For the critical 
point R to lie in the first quadrant, one of the following conditions must hold: 
Either (i) C 4, C 5, and C 3 are all negative, or 


(ii) C 4, C >, and C 3 are all positive. 
Linearize by finding the Jacobian matrix. Therefore, 


J= p — 26x — yy —yx 
7 —cy b —2dy—cx } 


Linearize at each critical point. Thus 


For the critical point at P, 


Finally, for the critical point at R, 


| | ôC 2 yC 2 | 
Jr = = ; 

C tie C 3 dC 3 
Consider case (i) first. The fixed points are all simple and it is not difficult to 
show that O is an unstable node, P and Q are cols, and for certain parameter 
values R is a stable fixed point. A phase portrait is plotted in Figure 4.1(a), 
where eight of an infinite number of solution curves are plotted. Each trajectory 
is plotted numerically for both positive and negative time steps; in this way, 
critical points are easily identified in the phase plane. For the parameter values 
chosen here, the two species coexist and the populations stabilize to constant 
values after long time periods. The arrows in Figure 4.1(a) show the vector field 
plot and define the direction of the trajectories for system (4.1). The slope of 
each arrow is given by E at the point, and the direction of the arrows is 

ax 


determined from x and y. There is a stable node lying wholly in the first 


quadrant at R, and the nonzero populations x(t) and y(t) tend to this critical point 
with increasing time no matter what the initial populations are. The domain of 


stability for the critical point at R is therefore § p = {(x,y) € R? : x >0,y > O}- 
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Figure 4.1 (a) A possible phase portrait showing coexistence. Typically, C 1, C 2, and C 3 are all 
negative. (b) A possible phase portrait depicting mutual exclusion. Typically, C 1, C 2, and C 3 are all 


positive. Note that the axes are invariant in both cases. 


Now consider case (ii). The fixed points are all simple, and it is not difficult 
to show that O is an unstable node, P and Q are stable nodes, and R is a col. A 
phase portrait is shown in Figure 4.1(b), where nine of an infinite number of 
solution curves are plotted. Once more the trajectories are plotted for both 
positive and negative time iterations. In this case, one of the species becomes 
extinct. 

In Figure 4.1(b), the critical point lying wholly in the first quadrant is a 
saddle point or col, which is unstable. The long-term behavior of the system is 
divided along the diagonal in the first quadrant. Trajectories starting to the right 
of the diagonal will tend to the critical point at Q = (2, 0), which implies that 
species y becomes extinct. Trajectories starting to the left of the diagonal will 
tend to the critical point at P = (0, 2), which means that species x will become 
extinct. Numerically, the trajectories lying on the stable manifold of the saddle 


point in the first quadrant will tend towards the critical point at R. However, in 
the real world, populations cannot remain exactly on the stable manifold, and 
trajectories will be diverted from this critical point leading to extinction of one 
of the species. The domain of stability for the critical point at P = (0, 2) is given 
by Sp ={(x,y) € R? : x > 0,y > 0, y > x} The domain of stability for the 


critical point at Q = (2, 0) is given by So = {(x,y) € R2:x>O0,y> 0,y < x} 


4.2 Predator-Prey Models 


Consider a two-species predator-prey model in which one species preys on 
another. Examples in the natural world include sharks and fish , lynx and 
snowshoe hares , and ladybirds and aphids . A very simple differential equation 
— first used by Volterra in 1926 [10, 7] and known as the Lotka-Volterra model 
—is given in Example 2. 


Example 2. Sketch a phase portrait for the system 
x = x(a-—cy), y= y(yx- ô), (4.2) 


where q, c, y, and 6 are all positive constants, with x(t) and y(t) representing 
the scaled population of prey and predator, respectively, and t is measured in 
years. 


Solution. The terms appearing in the right-hand sides of equation (4.2) have a 
physical meaning as follows: 


e The term ax represents the growth of the population of prey in the absence of 
any predators. This is obviously a crude model; the population of a species 
cannot increase forever. 

e The terms — cxy and + yxy represent species interaction. The population of 
prey suffers and predators gain from the interaction. 

e The term -ôy represents the extinction of predators in the absence of prey. 


Attempt to construct a phase plane diagram in the usual way. Find the critical 
points, linearize around each one, determine the nullclines, and plot the phase 
plane portrait. 

The critical points are found by solving the equations x = ý = 0. There are 


two critical points, one at O = (0, 0) and the other at p — ( 5 2); 
ye 


Linearize to obtain 


@-cy -cx 
J= ; 
yy 0+yx 


The critical point at the origin is a saddle point, and the stable and unstable 
manifolds lie along the axes. The stable manifold lies on the positive y-axis and 
the unstable manifold lies on the x-axis. The critical point at P is not hyperbolic, 
and so Hartman’s Theorem cannot be applied. System (4.2) has solution curves 
(the differential equation is separable) given by x °y % e X e 79 = K, where K is 
a constant. These solution curves may be plotted in the phase plane. The 
nullclines are given by x = 0, y = a where the flow is vertical, and y = 0, y = 


, where the flow is horizontal. The vector fields are found by considering x, y, 


and <’. A phase portrait is shown in Figure 4.2. 
dx 
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Figure 4.2 A phase portrait for the Lotka-Volterra model. 


The population fluctuations can also be represented in the tx and ty planes. 
The graphs shown in Figure 4.3 show how the populations of predator and prey 
typically oscillate. 


Figure 4.3 (a) Time series plots, periodic behavior of the prey and predators for one set of initial 
conditions, namely x(0) = 1, y(0) = 2. The population of prey is shown as the dashed curve and the 
population of predator is a solid curve. 


Note that the oscillations are dependent on the initial conditions. In 
Figure 4.3, the period of both cycles is about 5 years. Different sets of initial 
conditions can give solutions with different amplitudes. For example, plot the 
solution curves in the tx and ty planes for the initial conditions x(0) = 3 and y(0) 
= 5. 

How can this system be interpreted in terms of species behavior? Consider 
the trajectory passing through the point (1, 1) in Figure 4.2. At this point the ratio 
of predators to prey is relatively high; as a result the population of predators 
drops. The ratio of predators to prey drops, and so the population of prey 
increases. Once there are lots of prey, the predator numbers will again start to 
increase. The resulting cyclic behavior is repeated over and over and is shown as 
the largest closed trajectory in Figure 4.2. 

If small perturbations are introduced into system (4.2)—to model other 
factors, for example—then the qualitative behavior changes. The periodic cycles 
can be destroyed by adding small terms into the right-hand sides of system (4.2). 
The system is said to be structurally unstable (or not robust ). 

Many predator-prey interactions have been modeled in the natural world. For 
example, there are data dating back over 150 years for the populations of lynx 
and snowshoe hares from the Hudson Bay Company in Canada. The data clearly 
shows that the populations periodically rise and fall (with a period of about 10 
years) and that the maximum and minimum values (amplitudes) are relatively 
constant. This is not true for the Lotka-Volterra model (see Figure 4.2). Different 
initial conditions can give solutions with different amplitudes. In 1975, Holling 
and Tanner constructed a system of differential equations whose solutions have 


the same amplitudes in the long term, no matter what the initial populations. 
Two particular examples of the Holling-Tanner model for predator-prey 
interactions are given in Example 3. 

The reader is encouraged to compare the terms (and their physical meaning) 
appearing in the right-hand sides of the differential equations in Examples 1-3. 


Example 3. Consider the specific Holling-Tanner model 
6xy 


ž=x(1-3) -= p=02y(1-“), (4.3) 


where N is a constant with x(t) # 0 and y(t) representing the populations of 
prey and predators, respectively. Sketch phase portraits when (i) N = 2. 5 and (ii) 
N=0.5. 


Solution. The terms appearing in the right-hand sides of equation (4.3) have a 
physical meaning as follows: 


e The term , ( i= 3) represents the usual logistic growth in the absence of 
i 7 


predators. 
e The term __ ®*y_ represents the effect of predators subject to a maximum 
(7+7x) 
predation rate . 
e The term 02y ( J-M ) denotes the predator growth rate when a maximum of 
2 7 


x/N predators is supported by x prey. 


Construct a phase plane diagram in the usual way. Find the critical points, 
linearize around each one, determine the nullclines, and plot a phase plane 
portrait. 

Consider case (i). The critical points are found by solving the equations 
x = ý = 0). There are two critical points in the first quadrant, A = (5, 2) and B = 


(7, 0). The Jacobian matrices are given by 


{=i -3/4 
n=| 0 1/5 | 


and 


ia| 710/21 -5/7 
"A oo is 


The eigenvalues and eigenvectors of J , are given by à , = —1; (1,0) and À > 
= 14; (-2, |)’. Therefore, this critical point is a saddle point or col with the 


stable manifold lying along the x-axis and the unstable manifold tangent to the 
line with slope -$ in a small neighborhood around the critical point. The 


eigenvalues of J g are given by A % —0. 338 + 0. 195i. Therefore, the critical point 


at B is a stable focus. 
A phase portrait showing four trajectories and the vector field is shown in 
Figure 4.4(a). 


a b 


Figure 4.4 (a) A phase portrait for system (4.3) when N = 2. 5. (b) Intersection of the nullclines. 


The populations eventually settle down to constant values. If there are any 
natural disasters or diseases, for example, the populations would both decrease 
but eventually return to the stable values. This is, of course, assuming that 


neither species becomes extinct. There is no periodic behavior in this model. 
Consider case (ii). The critical points are found by solving the equations 
x = ý = 0). There are two critical points in the first quadrant, A = (1, 2) and B= 


(7, 0). The Jacobian matrices are given by 


_{-1 -3/4 
n=| 0 1/5 | 


and 


pal Aa 
E T 


The eigenvalues and eigenvectors of J 4 are given by à , = —1; (1, 0)’ and À > 
= 15; (-2, |)’. Therefore, this critical point is a saddle point or col with the 


stable manifold lying along the x-axis and the unstable manifold tangent to the 
line with slope -$ near to the critical point. The eigenvalues of J g are given by 


A 0. 043 + 0. 335i. Therefore, the critical point at B is an unstable focus. 
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Figure 4.5 [Python] (a) A phase portrait for system (4.3) when N = 0. 5. (b) Intersection of the nullclines. 


All trajectories lying in the first quadrant are drawn to the closed periodic 
cycle shown in Figure 4.5(a). Therefore, no matter what the initial values of x(t) 
and y(t), the populations eventually rise and fall periodically. This isolated 
periodic trajectory is known as a stable limit cycle . In the long term, all 
trajectories in the first quadrant are drawn to this periodic cycle, and once there, 
remain there forever. Definitions and the theory of limit cycles will be 
introduced in Chapter 5 The nullclines are plotted in Figure 4.5(b), these curves 
show where the flow is horizontal or vertical, in this case. Figure 4.6 shows the 
time series plots for the Holling-Tanner model. 
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Figure 4.6 [Python] Time series for the Holling-Tanner predator-prey model. 


The limit cycle persists if small terms are added to the right-hand sides of the 
differential equations in system (4.3). The system is structurally stable (or 
robust ) since small perturbations do not affect the qualitative behavior. Again 
the populations of both predator and prey oscillate in a similar manner to the 
Lotka-Volterra model with another major exception. The final steady-state 
solution for the Holling-Tanner model is independent of the initial conditions. 
Use Python to plot time series plots for the solutions plotted in Figure 4.5(a) as 
in Program 4b in Section 4.4. The period of the limit cycle can be easily 
established from the time series plot. This model appears to match very well 
with what happens for many predator-prey species in the natural world—for 
example, house sparrows and sparrow hawks in Europe, muskrat and mink in 
Central North America, and white-tailed deer and wolf in Ontario. 

From the time series plot, the period, say, T, of the limit cycle is 
approximately 19 units of time. Thus if t is measured in six-month intervals, then 
this would be a good model for the lynx and snowshoe hare populations, which 
have a natural period of about 10 years. Periodicity of limit cycles will be 
discussed in the next chapter. 


4.3 Other Characteristics Affecting Interacting 
Species 
A simple model of one species infected with a disease was considered in 


Chapter 3 The models considered thus far for interacting species have been 
limited to only two populations, and external factors have been ignored. Hall et 
al. [3] consider a stable host-parasite system subject to selective predation by a 
predator species. They consider a microparasite—zooplankton—fish system 
where the host is Daphnia dentifera and the predator fish species is bluegill 
sunfish . They investigate how predator selectivity on parasitized and 
nonparasitized hosts affects the populations. The differential equations are given 
by 


tr. 
| 


= bS[1-—c(S +D]-dS —BSI- fs(S,1, P), 
= BSI—(d+a)l— fi(S,1,P), 


~ 
| 


(4.4) 

where S is the susceptible population, I is the infected population, b is the birth 
rate, c is the density dependence of birth rates, d is the mortality rate, p 
represents contact with infected hosts, and qa is the parasite induced mortality 
rate. The functions f ș and f ; represent predator interaction with a saturating 


functional response, given by 


PS POI 


S,I, P) = S, 1, P) = ———_., 
fs ) / fil ) hs + S + Oyl 


hg +S + yl i 
where P is a predation intensity term, @ represents the selectivity of the predator, 
h s represents a half-saturation constant of predators for susceptible hosts, and y 


is a handling time for susceptible and infected hosts. More details and 
bifurcation diagrams are plotted in the research paper [3], and it is shown how 
predation selectivity can affect the host-parasite system. For example, for the 
parameter values b = 0. 4, ¢ = +» 0=5,a=ß=d=0.05,P=1,andy=hs=1, 


it is shown that the host-parasite system coexists in a periodic manner as 
depicted in Figure 4.7. Python command lines for producing time series data are 
listed in Section 4.4. 
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Figure 4.7 Coexistence of the host-parasite species when P = 1 and the productivity term, 1 


= 20 - There 


is a limit cycle in the SI plane. 


Note that for other parameter values, predation can catalyze extinction of both 
hosts and parasites. 

There are a great many research papers published every year on interacting 
species, and the author hopes that this chapter will inspire the reader to 
investigate further. To conclude Chapter 4, some other characteristics ignored 
here will be listed. Of course, the differential equations will become more 
complicated and are beyond the scope of this chapter. 


e Age classes —for example, young, mature, and old; time lags need to be 
introduced into the differential equations (see Chapters 12 and 13). 
Diseases—epidemics affecting one or more species (see Chapter 3). 
Environmental effects . 

Enrichment of prey —this can lead to extinction of predators. 
Harvesting and culling policies (see Chapter 13). 

Pollution —persistence and extinction. 

Refuge —for example, animals in Africa find refuge in the bush. 
Seasonal effects —for example, some animals hibernate in winter. 


e Three or more species interactions (see the exercises in Section 4.5). 


One interesting example is discussed by Lenbury et al. [6], where predator- 
prey interaction is coupled to parasitic infection. One or both of the species can 
become infected, and this can lead to mathematical problems involving four 
systems of differential equations. The dynamics become far more complicated, 
and more interesting behavior is possible. Higher-dimensional systems will be 
discussed later in the book. Different types of species interaction are investigated 
in [8]. 


4.4 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


ffigsize | # The size of the figure. 
finfodict  |# Dictionary containing extra 


C 
legend | Plot a legend on a figure. 
subplots  |# Multiple plots on one graph. 


# Program 04a: Holling- 
Tanner model. See Figures 4.5 and 4.6. 

# Time series and phase portrait for a predator- 
prey system. 

import numpy as np 

from scipy import integrate 

import matplotlib.pyplot as plt 


# The Holling-Tanner model. 
def Holling_Tanner(X, t=0): 
# here X[0] = x and X[1] = y 
return np.array([ X[0] (4 - X[0]/7) - 6 X[0] 


X[1]/(7 + 7*X[0]), 
0.2 X[1] (14 - 0.5 * X[1] / X[0]) ]) 


t = np.linspace(0, 200, 1000) 
# initial values: x0 = 7, yO = 0.1 
SysO = np.array([7, 0.1]) 


X, infodict = integrate.odeint(Holling_Tanner, Sys0 
, t, full_output = True) 
Xy 2 xXT 


fig = plt.figure(figsize=(15, 5)) 
fig.subplots_adjust(wspace = 0.5, hspace = 0.3) 
ax1 = fig.add_subplot(1, 2, 1) 

ax2 = fig.add_subplot(1, 2, 2) 


axi.plot(t, x, ‘r-’, label 
axi.plot(t, y, ‘b-’, label 


= 'prey’) 
ax1.set_title("Time Series") 


'predator’) 


ax1.set_xlabel("time") 
ax1.grid() 
ax1.legend(loc=’best’ ) 


ax2.plot(x, y, color = "blue") 
ax2.set_xlabel(’x’) 
ax2.set_ylabel(’y’) 
ax2.set_title(’Phase portrait’ ) 
ax2.grid() 

plt.show() 


4.5 Exercises 
1. Plot a phase portrait for the following competing species model 


X= 2x - x7 — xy, ý = 3y- y — 2xy 


and describe what happens in terms of species behavior. 


2. Plot a phase plane diagram for the following predator-prey system and 
interpret the solutions in terms of species behavior: 


5; 


(b) 


ž=2x-— xy, ý= —3y + xy. 


Plot a phase portrait for the following system and describe what happens to 
the population for different initial conditions: 


i=2x-x -— 4, ýġ=-y-y +x. 


The differential equations used to model a competing species are given by 
K=x2—-x-y), y =y(u-y-px), 
where p is a constant. Describe the qualitative behavior of this system as 
the parameter j varies. 
(a) Sketch a phase portrait for the system 
x=x(4-y-x), y=y3x-l-y) x20, y>0, 


given that the critical points occur at O = (0, 0), A = (4, 0), and B= 
(5/4, 11/4). 


Sketch a phase portrait for the system 
k=xQ2-y-x), y=y3-2x-y) x20, ys 0, 


given that the critical points occur at O = (0, 0), C = (0, 3), D= (2, 0), and E 
= (1, 1). 


One of the systems can be used to model predator-prey interactions and the other 
competing species. Describe which system applies to which model and interpret 
the results in terms of species behavior. 


A predator-prey system may be modeled using the 
differential equations 


X= x(1—-y-ex) y=y(-lt+x- 6y), 


where x(t) is the population of prey and y(t) is the 
predator population size at time t, respectively. 
Classify the critical points for € > 0 and plot phase 
portraits for the different types of qualitative 
behavior. Interpret the results in physical terms. 


7. 
A predator-prey model is given by 
= x(x-x — y), y=yx-0.6). 
Sketch a phase portrait and interpret the results in 
physical terms. 
8. 
Use Python to plot a trajectory for the predator- 
prey system 
ž= x(x- x-y), ý= y(x -— 0.48) 
using the initial condition (0. 6, 0. 1). What can you 
deduce about the long-term populations? 
9. 


Suppose that there are three species of insect X, Y, 
and Z, say. Give rough sketches to illustrate the 
possible ways in which these species can interact 
with one another. You should include the 
possibility of a species being cannibalistic. Three- 
dimensional systems will be discussed later. 

10. The following three differential equations are used where a ;j are positive 
to model a combined predator-prey and competing constants. Give a 
species system: physical interpretation 

for the terms appearing 

, in the right-hand sides of 

Y = Wa29 — mıx — aay — 4232), these differential 

Z = 2439 + A31X — azy — 4332), equations. 


X = X(A19 — 411X + ay2y — 4132), 
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5. Limit Cycles 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


To give a brief historical background. 

To define features of phase plane portraits. 
To introduce the theory of planar limit cycles. 
To introduce perturbation methods. 


On completion of this chapter, the reader should be able to 


prove existence and uniqueness of a limit cycle; 
prove that certain systems have no limit cycles; 
interpret limit cycle behavior in physical terms; 
find approximate solutions for perturbed systems. 


Limit cycles, or isolated periodic solutions, are the most common form of 
solution observed when modeling physical systems in the plane. Early 
investigations were concerned with mechanical and electronic systems, but 
periodic behavior is evident in all branches of science. Two limit cycles were 
plotted in Chapter 4 when considering the modeling of interacting species. 

The chapter begins with a historical introduction, and then the theory of 
planar limit cycles is introduced. 


5.1 Historical Background 


Definition 1. A limit cycle is an isolated periodic solution . 


Limit cycles in planar differential systems commonly occur when modeling both 
the technological and natural sciences. Most of the early history in the theory of 
limit cycles in the plane was stimulated by practical problems. For example, the 


differential equation derived by Rayleigh in 1877 [14], related to the oscillation 
of a violin string , is given by 


: l l 
X+€ z —-ljž+x=0, 


where E dx and + = d. Let x = y. Then this differential equation can be 
~ dÊ 4 


written as a system of first-order autonomous differential equations in the plane 
. . y2 
=y}; Your els = 19. (5.1) 


A phase portrait is shown in Figure 5.1. 


Figure 5.1 Periodic behavior in the Rayleigh system (5.1) when e = 1.0 


Following the invention of the triode vacuum tube, which was able to 
produce stable self-excited oscillations of constant amplitude, van der Pol [17] 
obtained the following differential equation to describe this phenomenon 


¥ + E(x = L)x+ x=0, 
which can be written as a planar system of the form 
ž=y, po -x-e(x?-1)y. (5.2) 


A phase portrait is shown in Figure 5.2. 


Figure 5.2 Periodic behavior for system (5.2) when € = 5. 0. 


The basic model of a cell membrane is that of a resistor and capacitor in 
parallel. The equations used to model the membrane are a variation of the van 
der Pol equation. The famous Fitzhugh-Nagumo oscillator [3, 15, 8] used to 
model the action potential of a neuron is a two-variable simplification of the 
Hodgkin-Huxley equations [5] (see Chapter 21). The Fitzhugh-Nagumo model 
creates quite accurate action potentials and models the qualitative behavior of 
the neurons. The differential equations are given by 


“= —uļu— (u —- 1)-v+%w, ý= e(u-— yv), 


where u is a voltage, v is the recovery of voltage, @ is a threshold, y is a shunting 
variable, and @ is a constant voltage. For certain parameter values, the solution 


demonstrates a slow collection and fast release of voltage; this kind of behavior 
has been labeled integrate and fire . Note that, for biological systems, neurons 
cannot collect voltage immediately after firing and need to rest. Oscillatory 
behavior for the Fitzhugh-Nagumo system is shown in Figure 5.3. Python 
command lines for producing Figure 5.3 are listed in Section 5.4. 
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Figure 5.3 [Python] A limit cycle for the Fitzhugh-Nagumo oscillator. In this case, y = 2. 54, 0 = 0. 14, œ 
= 0. 112, and e = 0. 01. The blue dashed curves are the nullclines, where the trajectories cross horizontally 
and vertically. 


Note that when œ = œ(t) is a periodic external input the system becomes 
nonautonomous and can display chaotic behavior [15]. The reader can 
investigate these systems via the exercises in Chapter 9 

Perhaps the most famous class of differential equations that generalize (5.2) 
are those first investigated by Liénard in 1928 [6], 


X+ f(x)x + g(x) = 0, 
or in the phase plane 
X=y, y= —g(x)— fx). (5.3) 


This system can be used to model mechanical systems, where f(x) is known as 
the damping term and g(x) is called the restoring force or stiffness . Equation 
(5.3) is also used to model resistor-inductor-capacitor circuits (see Chapter 2) 
with nonlinear circuit elements. Limit cycles of Liénard systems will be 
discussed in some detail in Chapters 10 and 11 

Possible physical interpretations for limit cycle behavior of certain 


dymamiecal evctamce ara lictad halaw: 


My LIULLIICUL yy VJLLLIIO ULL LLOLCU ULIV VV. 


e For an economic model, Bella [2] considers a Goodwin model of a class 
struggle and demonstrates emerging multiple limit cycles of different 
orientation. 

e For predator-prey and epidemic models, the populations oscillate antiphase 
with one another and the systems are robust (see Examples in Chapter 4, and 
Exercise 8 in Chapter 8). 

e Periodic behavior is present in integrate and fire neurons (see Figure 5.3). 
Indeed, the human body is full of oscillatory behavior as described in 
Chapter 12 

e For mechanical systems , examples include the motion of simple nonlinear 
pendula (see Section 9.3), wing rock oscillations in aircraft flight dynamics 
[11], and surge oscillations in axial flow compressors [1], for example. 

e For periodic chemical reactions , examples include the Landolt clock reaction 
and the Belousov-Zhabotinski reaction (see Chapter 8). 

e For electrical or electronic circuits, it is possible to construct simple electronic 
oscillators (Chua’s circuit , for example) using a nonlinear circuit element; a 
limit cycle can be observed if the circuit is connected to an oscilloscope. 


Limit cycles are common solutions for all types of dynamical systems. 
Sometimes it becomes necessary to prove the existence and uniqueness of a limit 
cycle, as described in the next section. 


5.2 Existence and Uniqueness of Limit Cycles in the 
Plane 


To understand the existence and uniqueness theorem, it is necessary to define 
some features of phase plane portraits. Assume that the existence and uniqueness 
theorem from Chapter 2 holds for all solutions considered here. 

The definitions listed in Chapter 2 can be extended to nonlinear planar 
systems of the form x = P(x, y), ý = Q(x, y), thus every solution, say, 


(t) = (x(t), y(t)), can be represented as a curve in the plane and is called a 


trajectory. The phase portrait shows how the qualitative behavior is determined 
as X and y vary with t. The trajectory can also be defined in terms of the spatial 
coordinates x, as in Definition 3 below. A brief look at Example 1 will help the 
reader to understand Definitions 1—7 in this section. 


Definition 2. A flow on 332 is a mapping m : R? — sR? such that 


1. 
7m is continuous; 


n(x, 0) =x for all x € 92: 


A, t 4), t) = n(x, t1 +t). 
Definition 3. Suppose that I , is the maximal interval of existence . The 
trajectory (or orbit ) through x is defined as y(x) = {7(x, ft): t € i}. 
The positive semiorbit is defined as y*(x) = {(x, ft) : t > O}. 


The negative semiorbit is defined as y~(x) = {m(x, t) : t < 0}. 


Definition 4. 
The positive limit set of a point x is defined as 


A’ (x) = {y : there exists a sequence t, — œ such that x(x, t) > y}. 
The negative limit set of a point x is defined as 
A (x) = fy : there exists a sequence t, — —oo such that x(x, t) > y}. 


In the phase plane, trajectories tend to a critical point, a closed orbit, or infinity. 


Definition 5. A set S is invariant with respect to a flow if x € S implies that 
y(x) C S. 

A set S is positively invariant with respect to a flow if x € S implies that y * 
(x) CS. 

A set S is negatively invariant with respect to a flow if x € S implies that y 
“(x) CS. 

A general trajectory can be labeled y for simplicity. 


Definition 6. A limit cycle , say, I, is 


e a stable limit cycle if A *(x) =T for all x in some neighborhood; this implies 
that nearby trajectories are attracted to the limit cycle; 


e an unstable limit cycle if A (x) =T for all x in some neighborhood; this 
implies that nearby trajectories are repelled away from the limit cycle; 
e asemistable limit cycle if it is attracting on one side and repelling on the other. 


The stability of limit cycles can also be deduced analytically using the 
Poincaré map (see Chapter 9). The following example will be used to illustrate 
each of the Definitions 1—6 above and 7 below. 


Definition 7. The period, say, T, of a limit cycle is given by x(t) = x(t + T), 
where T is the minimum period. The period can be found by plotting a time 
series plot of the limit cycle (see the Python command lines in Chapter 4). 


Example 1. 
Describe some of the features for the following set of polar differential equations 
in terms of Definitions 1-7: 


r=rl-nNn2Q-nB-n, @=-1. (5.4) 
Solution. A phase portrait is shown in Figure 5.4. There is a unique critical point 
at the origin since ġ is nonzero. There are three limit cycles that may be 


determined from the equation 7 = 0. They are the circles of radii one, two, and 


three, all centered at the origin. Let I’ ; denote the limit cycle of radius r=i. 


Figure 5.4 Three limit cycles for system (5.4). 


There is one critical point at the origin. If a trajectory starts at this point, it 
remains there forever. A trajectory starting at (1, 0) will reach the point (—1, 0) 
when t į = 7 and the motion is clockwise. Continuing on this path for another 


time interval t 5 = 7, the orbit returns to (1, 0). Using part 3 of Definition 2, one 
can write z (7((1, 0), t1), t2) = a (C1, 0), 27) since the limit cycle is of period 27 


(see below). On the limit cycle I’ 4, both the positive and negative semiorbits lie 
on I’. 
Suppose that P = (5, 0) and Q = (4, 0) are two points in the plane. The limit 


sets are given by A *(P) =T ,, A (P) = (0, 0), A *(Q) =T >, and A 7(Q) = œ. 
The annulus 4, = {r € R? : 0 < r< 1} is positively invariant, and the 


annulus A, = {r € R? : 1 < r< 2} is negatively invariant. 


IfO<r< 1, then 7 > 0 and the critical point at the origin is unstable. If 1 < r 
< 2, then 7 < 0 and T4 is a stable limit cycle. If 2 < r < 3, then + > 0 andT , is 
an unstable limit cycle. Finally, if r > 3, then 7 < 0 and T ; is a stable limit 


cycle. 
Integrate both sides of ġ = —] with respect to time to show that the period 


of all of the limit cycles is 27. 
The Poincaré-Bendixson Theorem. Suppose that y * is contained in a 


bounded region in which there are finitely many critical points. Then A * (y) is 
either 


e asingle critical point; 
e asingle closed orbit; 
e a graphic —critical points joined by heteroclinic orbits . 


A heteroclinic orbit connects two separate critical points and takes an infinite 
amount of time to make the connection; more details are provided in Chapter 6 

Corollary. Let D be a bounded closed set containing no critical points and 
suppose that D is positively invariant. Then there exists a limit cycle contained 
in D. 

A proof to this theorem involves topological arguments and can be found in 
[13], for example. 


Example 2. 
By considering the flow across the rectangle with comers at (—1, 2), (1, 2), (1, 
—2), and (—1, —2), prove that the following system has at least one limit cycle: 


t=y-8x, p=2y-4x-2y. 
(5.5) 
Solution. The critical points are found by solving the equations x = ý = 0. Set y 
= 8x ?. Then ý = 0 if x(1 — 4x 2 + 256x ê) = 0. The graph of the function y = 1 - 


4x * + 256x 8 is given in Figure 5.5(a). The graph has no roots and the origin is 
the only critical point. 

Linearize at the origin in the usual way. It is not difficult to show that the 
origin is an unstable focus. 

Consider the flow on the sides of the given rectangle: 


e Ony=2,|x|<1, y= —4x- 12 <0. 
e Ony=-2,|/x|<1, ý= —4x+ 12> 0. 
e Onx=1,|y|<2,x=y-8 <0. 

e Onx=-1,/y|<2, y=y+8>0. 


The flow is depicted in Figure 5.5(b). The rectangle is positively invariant 
and there are no critical points other than the origin, which is unstable. Consider 
a small deleted neighborhood , say, N „ around this critical point. For example, 


the boundary of N , could be a small ellipse. On this ellipse, all trajectories will 


cross outwards. Therefore, there exists a stable limit cycle lying inside the 
rectangular region and outside of N , by the corollary to the Poincaré-Bendixson 


theorem. 
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Figure 5.5 (a) Polynomial of degree 8. (b) Flow across the rectangle for system (5.5). 
Definition 8. A planar simple closed curve is called a Jordan curve . 


Consider the system 
x= P(x,y), y= Qy): (5.6) 


where P and Q have continuous first-order partial derivatives. Let the vector 
field be denoted by X and let w be a weighting factor that is continuously 
differentiable. Recall Green’s Theorem, which will be required to prove the 
following two theorems. 

Green’s Theorem. Let J be a Jordan curve of finite length. Suppose that P 
and Q are two continuously differentiable functions defined on the interior of J, 


say, D. Then 
I, 


Dulac’s Criterion. Consider an annular region, say, A, contained in an 


ðP AQ 
ax dy 


dx dy = p Pdy — Qdx. 
J 


open set E. If 
a) ) 
V.(WX) = div (yX) = ZUP) + FUD 


does not change sign in A, where w is continuously differentiable, then there 
is at most one limit cycle entirely contained in A. 


Proof. 
Suppose that I’, and I’, are limit cycles encircling K, as depicted in Figure 5.6, 


of periods T į and T 5, respectively. Apply Green’s Theorem to the region R 
shown in Figure 5.6. 


lf i. O) ax weg WPdy — WwQdx+ 


Í wPdy — wOdx - h WPdy ~ WOdx - Í wPdy ~ uQdx. 
Å Ti L 


Now on I", andI’5, x = P and y = Q, so 


{f a. we dedy 
Oy 
T2 


Ti 
= (YPO - WQP) dt - F (WPO — WQP)dt, 


which is zero and contradicts the hypothesis that div(w X) # 0 in A. 
Therefore, there is at most one limit cycle entirely contained in the annulus A. 


Example 3. 
Use Dulac’s criterion to prove that the system 


4 = -yt x(1— 2x? —3y"), p= x +y -2x — 3y’) (5.7) 
has a unique limit cycle in an annulus. 


Solution. Convert to polar coordinates using the transformations 


: ; ; ay: ‘ ; 
ri = xx + yý, US xý- y. 


Figure 5.6 Two limit cycles encircling the region K. 
Therefore, system (5.7) becomes 


r=ri- or = r? sin?ð), ġ=1. 


Since ġ = |, the origin is the only critical point. On the circle ; = |, 
j= I(t _ 1 sin? 0). Hence 7 > 0 on this circle. On the circle r = 1, 
i = —] — sin? @- Hence ż < O on this circle. If r > 1, then 7 < 0, and if 


0 <r < Ł, then } > 0. Therefore, there exists a limit cycle in the annulus 


A ={r:4<r< 1} by the corollary to the Poincaré-Bendixson theorem. 


NI— 


Consider the annulus A. Now div(X) = 2(1 — 4r ? - 2r sin? 0). If 1 pa j; 


then div(X) < 0. Since the divergence of the vector field does not change sign in 
the annulus A, there is at most one limit cycle in A by Dulac’s criterion. 
A phase portrait is given in Figure 5.7. 
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Figure 5.7 A phase portrait for system (5.7) showing the unique limit cycle. 


Example 4. 
Plot a phase portrait for the Liénard system 
x=y,y=-x- y(x Fadak + agx° -+ agx® + Bion” aoe = Wax); 


where a 5 = 90, a 4 = —882, a ¢ = 2598. 4, a g = —3359. 997, a 49 = 2133. 34, a 45 
= —651. 638, and a 44 = 76. 38. 


Solution. Not all limit cycles are convex closed curves as Figure 5.8 
demonstrates. 


Figure 5.8 A phase portrait for Example 4. The limit cycle is a nonconvex closed curve. 


5.3 Nonexistence of Limit Cycles in the Plane 


Bendixson’s Criterion. Consider system (5.6 ) and suppose that D is a simply 
connected domain (no holes in D) and that 


ð ð 
V.X) = div YX) = —(WP) + —(WQ) # 0 
Ox Oy 
in D. Then there are no limit cycles entirely contained in D. 


Proof. 
Suppose that D contains a limit cycle I of period T. Then from Green’s Theorem 


T aa, WO ax a = Q wPay - Yod») 


-f goeta 


since on T, x = P and ý = Q. This contradicts the hypothesis that div(w X) # 0, 


and therefore D contains no limit cycles entirely. 


Definition 9. 

Suppose there is a compass on a Jordan curve C and that the needle points in the 
direction of the vector field. The compass is moved in a counterclockwise 
direction around the Jordan curve by 27 radians. When it returns to its initial 
position, the needle will have moved through an angle, say, ©. The index , say, I 
x(C), is defined as 


- 
Ix(C) = 


where A@ is the overall change in the angle © 


The above definition can be applied to isolated critical points. For example, the 
index of a node, focus, or center is + 1 and the index of a col is — 1. The 
following result is clear. 


Theorem 1. The sum of the indices of the critical points contained entirely 
within a limit cycle is + 1. 


The next theorem then follows. 
Theorem 2. A limit cycle contains at least one critical point. 


When proving that a system has no limit cycles, the following items should be 
considered: 


1. 
Bendixson’s criterion; 


2. 
indices; 
3. 
invariant lines; 


4. 


critical points. 


Example 5. Prove that none of the following systems have any limit cycles: 
@)¢=1l+y-e", y=xt+cos’y. 


b) =y -x, PS y+ x + eae 
()ta=ytx, paoxtyty. 
(dd) t=2xy-2y*, jars y? — xy”. 


(e) x= x(2-y- x), ý=yáx-x -3), given w=H. 


Solutions. 

(a) The system has no critical points and hence no limit cycles by 
Theorem 2. 

(b) The origin is the only critical point and it is a saddle point or col. Since 
the index of a col is — 1, there are no limit cycles from Theorem 1. 

(c) Find the divergence, giyX = oP 4 os = 3x7 4 3y? +1 #0 Hence there 
are no limit cycles by Bendixson’s eae 

(d) Find the divergence, gqjyx = 2 as Oe a ai xy: Now divX = 0 if either 


Oy 


x = 0 or y = 0. However, on the line x = 0, y = —2y* < 0, and on the line y = 0, 
ý = x? > 0. Therefore, a limit cycle must lie wholly in one of the four 


quadrants. This is not possible since divX is nonzero here. Hence there are no 
limit cycles by Bendixson’s criterion. Draw a small diagram to help you 
understand the solution. 

(e) The axes are invariant since x = 0 if x = 0 and y = 0 if y = 0. The 


weighted divergence is given by diy(wX) = 2y P) + 7 £(yQ) = -1 


Therefore, there are no limit cycles contained entirely in any of the sea 
and since the axes are invariant, there are no limit cycles in the whole plane. 


Example 6. 


Drain that tha errectam 


FLUve UdL UIC SOYOLCLit 
X=x1-4x4+y), ypo=oy2+3x-2y) 
has no limit cycles by applying Bendixson’s criterion with y = xy". 


Solution. The axes are invariant since x = 0 on x = 0 and y = 0 on y = 0. Now 


div(wX) = mal ae io Ayr? + atly) 4 


ð (2x"y mtl , gymtlyntl _ 9 ym, i 
ay % w 


which simplifies to 
div(WX) = (m + 2n + 2)x"y" + (—4m + 3n — 5)x"*1y" + (m — 2n — 3)" y", 


Select m 


1 and p = —2. Then 
2 4 


43 3 _: 
div(yX) = — 7 xy, 


Therefore, there are no limit cycles contained entirely in any of the four 
quadrants, and since the axes are invariant, there are no limit cycles at all. 


5.4 Perturbation Methods 


This section introduces the reader to some basic perturbation methods by means 
of example. The theory involves mathematical methods for finding series 
expansion approximations for perturbed systems. Perturbation theory can be 
applied to algebraic equations, boundary value problems, difference equations, 
Hamiltonian systems, ODEs, PDEs, and in modern times the theory underlies 
almost all of quantum field theory and quantum chemistry. There are whole 
books devoted to the study of perturbation methods and the reader is directed to 
the references [4, 9], and [16], for more detailed theory and more in-depth 
explanations. 

The main idea begins with the assumption that the solution to the perturbed 
system can be expressed as an asymptotic or Poincaré expansion of the form 


x(t, €) = xo(t) + €x, (1) + x(t) +.... 
(5.8) 


Definition 10. 
The sequence f(e) ~ ¥ ,-9 ~ a, © ,(€) is an asymptotic expansion of the 
continuous function f(e) if and only if, for all n = 0, 
N 
f(e) = » Anb,(€) + O(bnsi(€)) ase —> 0, 

n=0 
(5.9) 
where the sequence constitutes an asymptotic scale such that for every n > 0, 


dni i(€) = 0(@,(€)) as e> 0. 


Definition 11. 
An asymptotic expansion (5.9) is said to be uniform if in addition 


R(x, ©| < Kløn+1 (©), 


for € in a neighborhood of 0, where the Nth remainder R y(x, €) = O(® y+1(€)) as 
€ > 0, and K is a constant. 


In this particular case, we will be looking for asymptotic expansions of the form 


x(t, €) ~ X DSE), 
k 

where 6 (£) = e K is an asymptotic scale. It is important to note that the 
asymptotic expansions often do not converge; however, one-term and two-term 
approximations provide an analytical expression that is dependent on the 
parameter, €, and some initial conditions. The major advantage that the 
perturbation analysis has over numerical analysis is that a general solution is 
available through perturbation methods where numerical methods only lead to a 
single solution. 

As a simple introduction consider the following first order ordinary 
differential equation: 


Example 7. 


Suppose that for x > 0, 


dx ; 

—+x-ex’ =0, x(0) = 2. (5.10) 
dt 

Determine a three term approximation and use Python to plot these 
approximations against the numerical solution when e€ = 0. 3. 


Solution. This equation can be solved directly using Python, see Chapter 2, and 
a numerical solution can also be computed. To obtain a series solution, set 


0,0 = x0 +e) +e x) +... 


where in order to satisfy the initial condition x(0) = 2, we will have x ,(0) = 0, x 
,(0) = 0, and so on. To compute to O(e °), substitute the first three terms into 


system (5.10) and collect powers of € using the collect command in Python. The 
commands are: 


In[1]: from sympy import * 
In[2]: x0=Function(’x0’ );x1=Function(’x1’ );x2=Function 
("x2"); 
x=Function(’x’); 
In[3]: t=Symbol(’t’);eps=Symbol(’eps’ ); 
In[4]: x=x0(t)+eps*x1(t)+eps**2*x2(t); 
In[4]: expr=x.diff(t)+x-eps*x**2; 
In[5]: expr=expand(expr); 
In[6]: collect(expr,eps) 


one obtains: 


O: X(t) + xo(t) = 0 
hs i(t) + xilt) - xolt) = 0, 
2 3 X(t) + x0(f) — 2xo(t)x1(f) = 0, 


“MN MN OM 


and we solve at each order, applying the initial conditions as we proceed. 
For O(1): 


Xo(t) + xo) = 0, xo(0)=2, 


and the solution using Python: 


In[7]:=dsolve(x(t).diff(t)+x(t),x(t)) 


is x p(t) = Cle “4 and as x ,(0) = 2, then C1 = 2. 
For O(e): 


(N+ x(t) =4e, x1 (0) = 0, 
and the solution using Python is x(t) = (C1 -— 4e) e”, and substituting x 
1(0) = 0, gives x(t) =4 G = a) 

For O(e °): 


Xo(t) + xo(t) = 4e“ x(t), x(0) = 0, 


and the solution using Python is v(t = (c l=162e% 48 e=?) e~t, and 
substituting x (0) = 0, gives Yt) = 8 ( slale ss. e=): 
Therefore, the solution to second order is: 
x(t) ~ 2e™ + 4e (e~ — g=) pge G =J 4 e*) 


Figure 5.9 shows the approximate solutions against the numerical solution. 


— it) 
— OA) 
— Ole) 
— Ole) 


Figure 5.9 [Python] The numerical solution against the O(1), O(£€), and O(e 2) solutions when € = 0. 3. 


To keep the theory simple and in relation to other material in this chapter, the 
author has decided to focus on perturbed ODEs of the form 


(R 11\ 


W.J) 


X+X=€f (xx), 
where 0 <€ < Land f (x, x) is an arbitrary smooth function. The 


unperturbed system represents a linear oscillator and when 0 < € < 1, system 
(5.11) becomes a weakly nonlinear oscillator. Systems of this form include the 
Duffing’s equation 


. 3 
X¥+xX=€X, 


(5.12) 
and the van der Pol equation 


t+x=e(x-1)x. (5.13) 


Example 8. Use perturbation theory to find a one-term and two-term 
asymptotic expansion of Duffing’s equation (5.12) with initial conditions x(0) = 
land x(Q) = 0. 


Solution. Substitute (5.8) into (5.12) to get 


2 


—= (xp he E 4 Gp Gc. Sete + ee sce 
dt? 


Use the collect command in Python to group terms according to powers of g, 
[žo + xo] + € Es +x- xo] + O(e7) = 0. 
The order equations are 
O11): XxX + xo = 0, xo(0)= 1,  xo(0)=0, 


Ole): Xi + xj =a x (0) = 0, a) =, 


The O(1) solution is x 9 = cos(t). Let us compare this solution with the numerical 
solution, say, x y, when € = 0. 01. Figure 5.10 shows the time against the error, x 
NT Xo for 0 < t< 100. 


XN Xo 


00 
-0.2 


-0.4 


Figure 5.10 [Python] The error between the numerical solution x y and the one-term expansion x ọ for the 
Duffing system (5.12) when e€ = 0. 01. 


Using Python, the O(e) solution is computed to be 
S 1 l a 
xı = =t sin(t) + —cos(t) — — cos™ (t). 
=g (£) 3 (t) z (£) 


Using the trigsimp command in Python does not simplify the expression any 
further; therefore, we have 


3 2 1 1 
X ~ Xp = Xo + EX] = cos(t) + € eu) + 8 cos(t) — 8 cos*(f) , 
where x p represents the Poincaré expansion up to the second term. The term 
tsin(t) is called a secular term and is an oscillatory term of growing amplitude. 


Unfortunately, the secular term leads to a nonuniformity for large t. Figure 5.11 
shows the error for the two-term Poincaré expansion, X y — X p, When e = 0. 01. 


Figure 5.11 The error between the numerical solution x y and the two-term expansion x p for the Duffing 


system (5.12) when € = 0. 01. 


By introducing a strained coordinate, the nonuniformity may be overcome 
and this is the idea behind the Lindstedt-Poincaré technique for periodic systems. 
The idea is to introduce a transformation of the form 


T 2 
go re Ooms 


(5.14) 
and seek values @ 4, @ 5,... that avoid secular terms appearing in the expansion. 


Example 9. Use the Lindstedt-Poincaré technique to determine a two-term 
uniform asymptotic expansion of Duffing’s equation (5.12) with initial 
conditions x(0) = 1 and x(0) = 0. 


Solution. Using the transformation given in (5.14) 
d dtd 
dt dtdt 


d 


= (1 + ew + ew +--+) =, 
dt 


d 


2 d 
— = (1 +ew tew) ==: 
dr dr? 


Applying the transformation to equation (5.12) leads to 


+x, 


Co aT 


where x is now a function of the strained variable t. Assume that 
X(T, €) = Xo(T) + EXIT) + X(T) +... (5.15) 


Substituting (5.15) into (5.12) using Python (see Section 5.5) gives the following 
order equations: 


O(1): tx + xo = 0, 
x(t=0)=1, ““(7=0)=0 


dt 


: 1? 
Ole): 53 +a a 


Os 0, (0) = 


Oe): 2 F +X = 3x¢x) — 
+(0) = 0, 220) =0 


— (Ww? + 2wy) 2, 


The O(1) solution is x g(t) = cos(t). Using Python and the trigsimp command, the 
solution to the O(¢) equation is 


xı(T) = : sin(t) (3T + 8wıT + cos(T) sin(T)) . 


To avoid secular terms, select ¢,), = 3; then the O(e) solution is 


l. 
x (T) = 8 sin“(T) cos(T). 
Using Python, the O(e °) solution is 


1 
X(T) = 510 sin(t) (427 + 512wot + 23 sin(2T) — sin(4T)), 


and selecting w = -4 avoids secular terms. 
The two-term uniformly valid expansion of equation (5.12) is 
E. 
X(T, €) ~ Xpp = COs(T) + 8 sin? (T) cos(T), 


where 


3 2l 3 3 
sil l= p= ; 
ToT a ie 


as € > 0. Note that the straining transformation is given to a higher order than 
the expansion of the solution. The difference between the two-term uniform 
asymptotic expansion and the numerical solution is depicted in Figure 5.12. 
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Figure 5.12 The error between the numerical solution x y and the two-term Linstedt-Poincaré expansion x 
LP for the Duffing system (5.12) when € = 0. 01. 


Unfortunately, the Lindstedt-Poincaré technique does not always work for 
oscillatory systems. An example of its failure is provided by the van der Pol 
equation (5.13). 


Example 10. Show that the Lindstedt-Poincaré technique fails for the ODE 
(5.13) with initial conditions x(0) = 1 and (0) = O. 


Solution. Substituting (5.15) into (5.13) using Python gives the following order 
equations: 


O(1) : £32 + xo =0, 
xo(t=0)=1, 287 =0) =0, 


dt 


OC ) : dx] + — dxo _ ,2dxX0 _ p) dxo 
E a TMS r Oar e? 


x(0)=0, (0) =0, 


dt 


The O(1) solution is x g(t) = cos(t). Using Python, the solution to the O(e) 
equation can be simplified to 


xT) = = (6T cos(T) — (5 — 16Tw; + cos(2T)) sin(T)) 
or 


x(t) = = ({6T cos(T) + 16Tw, sin(T)} — (5 + cos(2T)) sin(T)). 


To remove secular terms set 4); = -= cot(t), then 


X(T, €) = cos(T) + O(€), 


where 
3 > 
T=t- act cot(t) + O(e-). 


This is invalid since the cotangent function is singular when t = nz, where n is an 
integer. Unfortunately, the Lindstedt-Poincaré technique does not work for all 
ODEs of the form (5.11); it cannot be used to obtain approximations that evolve 
aperiodically on a slow time scale. 

Consider the van der Pol equation (5.13), Figure 5.13 shows a trajectory starting 
at x(0) = 0.1, x(0) = O for £ = 0. 05 and 0 < t < 800. The trajectory spirals 


around the origin and it takes many cycles for the amplitude to grow 
substantially. As t > 00, the trajectory asymptotes to a limit cycle of approximate 
radius two. This is an example of a system whose solutions depend 
simultaneously on widely different scales. In this case there are two time scales: 
a fast time scale for the sinusoidal oscillations ~ O(1), and a slow time scale 
over which the amplitude grows ~ Q( ). The method of multiple scales 


introduces new slow-time variables for each time scale of interest in the 
problem. 


Figure 5.13 A trajectory for the van der Pol equation (5.13) when € = 0. 05. 


The Method of Multiple Scales 
Introduce new time scales, say, T ọ = t and T4 = €t, and seek approximate 


solutions of the form 
X(t, 6) ~ 20 (re, TI) Fexr (79, T1) Pere (5.16) 


Substitute into the ODE and solve the resulting PDEs. An example is given 
below. 


Example 11. Use the method of multiple scales to determine a uniformly valid 
one-term expansion for the van der Pol equation (5.13) with initial conditions 
x(0) =a and x(0) = 0. 


Solution. Substituting equation (5.16) into (5.13) using Python gives the 
following order equations: 


O(1) : = + x9 = 0, 


ar, 
\. xy —_9 2w _ (2 _ 1)\ 2x0 
Ole) : Ore TALS 2 For (x) 1) 52. 


The general solution to the O(1) PDE may be found using Python, 
Xo (To, T1) = €1(T1) COS(To) + €2(T1) sin(T0) 
which using trigonometric identities can be expressed as 
Xo (To, T1) = R(t) cos(To + (71), (5.17) 


where R(t ;) and @(t 4) are the slowly varying amplitude and phase of x 9, 
respectively. Substituting (5.17), the O(€) equation becomes 


Pu ty = -2 ( sin(to + (71) + R1) Æ coslo + (71) 


ðt dt dt 


-R(T1) sin(To + 0(T1)) (R?(T1) cos?(To + (71) = 1). 


(5.18) 
In order to avoid resonant terms on the right-hand side which lead to secular 
terms in the solution it is necessary to remove the linear terms cos(T g + O(t ;)) 


and sin(t ọ + O(t ,)) from the equation. Use the trigsimp command in Python to 
reduce an expression to a form linear in the trigonometric function. Equation 


(5.18) then becomes 


Pay x, = f- r +R} sin(ro + OW) 


{-2R4} cos(to + 0(71)) — È sinto + 30(t1)). 
To avoid secular terms set 


dR R? dé 
-2— +R- aS) d —=0. l 
rm + 4 an a (5.19) 


The initial conditions are x 9(0, 0) = a and = — ¢ leading to 6(0) = 0 and 


R(0) = $. The solutions to system (5.19) with these initial conditions are easily 


computed with Python, thus 


R(t) = — s and @(7T,;) =0 


1+(4-1)es 


Therefore, the uniformly valid one-term solution is 


2 COS(To) 
XolTo, T1) = MR i e + O(€) 


1+($-1)e™ 


or 


Pp Nn A 


1+(4-l)e@ 


As t > œ, the solution tends asymptotically to the limit cycle x = 2cos(t) + O(e), 
for all initial conditions. Notice that only the initial condition a = 2 gives a 
periodic solution. 

Figure 5.14 shows the error between the numerical solution and the one-term 
multiple scale approximation, say, X ms, when € = 0.01, and x(0) = 1, x(0) = 0 
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Figure 5.14 The error between the numerical solution x y and the one-term multiple scale expansion x MS 
for the van der Pol equation (5.13) when € = 0.01, and x(0) = 1,x(0) = 0. 


5.5 Python Programs 


See earlier chapters for comments to aid understanding of some of the 
commands listed within the programs. 


# Program 05a: Limit cycle for Fitzhugh-Nagumo. 
# See Figure 5.3. 

import matplotlib.pyplot as plt 

import numpy as np 

from scipy.integrate import odeint 


theta = 0.14 

omega = 0.112 

gamma = 2.54 

epsilon = 0.01; 

xmin = -0.5 

xmax = 1.5 

ymin = 0 

ymax = 0.3; 

def dx_dt(x, t) 
return [- 


x[0] (x[O] - theta) (x[O] - 1) - x[1] + omega, 
epsilon (x[0] - gamma x[1])] 


# Trajectories in forward time. 
xs=odeint(dx_dt, [0.5, 0.09], np.linspace(0, 100, 1 
000) ) 


plt.plot(xs[:,0], xs[:,1], "r-") 


# Label the axes and set fontsizes. 
plt.xlabel(’u’, fontsize=15) 
plt.ylabel(’v’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.xlim(xmin, xmax) 

plt.ylim(ymin, ymax); 


# Plot the nullclines. 

X=np.arange(xmin, xmax, 0.01) 

plt.plot(x, x/gamma, ‘b--’, x, - 
x (x - theta) (x - 1) 

+ omega, ‘b--’) 

plt.show() 


# Program 05b: Example 7, approximate solutions. 
# See Figure 5.9. 


from scipy.integrate import odeint 
import matplotlib.pyplot as plt 
import numpy as np 


eps=0.3 
def ODE(x, t): 
return eps*x**2-x 


t = np.linspace(0, 10, 1000) 
sol = odeint(ODE, x0, t) 
x = np.array(sol).flatten() 


plt.plot(t,x,label=’x(t)’) 

plt.plot(t,2*np.exp(-t),label=’0(1)’) 

plt.plot(t,2*np.exp(-t)+4*eps*(np.exp(-t)- 
np.exp(-2*t)), \ 

label=’0($\epsilon $)’) 

plt.plot(t,2*np.exp(-t)+4*eps*(np.exp(-t)- 

np.exp(-2*t))+ \ 
eps**2*8*(np.exp(- 


t)-2*np.exp(-2*t)+np.exp(-3%*t)), \ 
label=’0($\epsilon42$)’ ) 


plt.xlabel(’t’, fontsize=15) 
plt.ylabel(’x’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.xlim(0, 8) 

plt.ylim(0, 2.1) 

plt.legend() 


plt.show() 


# Program 05c: Error between xN and x0. See Figure 
5.10. 

# Error between one term solution and numerical sol 
ution. 

from scipy.integrate import odeint 

import matplotlib.pyplot as plt 

import numpy as np 


def dx_dt(x,t): 
return [x[1], 0.01 x[0]*3 - x[0]] 


x0 = [1, 0] 

ts = np.linspace(0, 100, 2000) 
xs = odeint(dx_dt, x0, ts) 

xN = xs[:, 0] 


xpertO = np.cos(ts) 
plt.plot(ts, xN - xpert0) 
plt.xlabel(’t’) 
plt.ylabel(’$x_N-x_0$’) 
plt.show() 


# Program 05d: The Lindstedt-Poincare Method 
# Deriving the order epsilon equations. 
# See Example 9. 


from sympy import collect, expand, Function, Symbol 
x0 = Function(’x0’ ) 
x1 Function(’x1’ ) 


x2 = Function(’ x2’) 
x = Function(’x’ ) 
t = Symbol(’t’ ) 
eps = Symbol(’eps’ ) 
w1 = Symbol(‘w1’ ) 
= Symbol(‘w2’ ) 
x = xO(t) + eps xi(t) + eps * 2 * x2(t) 
expr = (1 + eps * w1 + eps ** 2 w2) *2 * x.diff(t, 


- eps * x ** 3 


expr = expand(expr ) 
expr = collect(expr, eps) 
print(expr ) 


5.6 Exercises 


1. 
Prove that the system 


; l 2 : 2 2 
t=yex(5-a -¥), ġ=-x+y(1-x -3°) 


has a stable limit cycle. Plot the limit cycle. 


By considering the flow across the square with coordinates (1, 1), (1, —1), 
(-1, -1), (-1, 1), centered at the origin, prove that the system 


x= -y+xcos(tx), ġ=x-y 
has a stable limit cycle. Plot the vector field, limit cycle, and square. 


Prove that the following systems have a unique limit cycle: 


(a) 
3 


k=x-y-xv, poxty-yp 


(b) 
dx 


= -y+x(1-px-(tp)y’), Z =x+y(1 -ux - +p’), 


where pl > p > 0. 


Prove that the system 
k=yt+xua-x-y), y=-xt+y(1l—-x-Yy’), 
where 0 < a < 1 has a limit cycle and determine its stability. 


For which parameter values does the Holling-Tanner model 


, X rxy l Ny 
= ees ' =} (1 = —} 
i | ] (a + ax) T= X 


have a limit cycle? 

Plot phase portraits for the Liénard system 
k=y-p(-x+x°), = x, 

when (a) p = 0. 01, and (b) p = 10. 


Prove that none of the following systems have limit cycles: 


(a) 

kay, ý=-x-(l1 +x +x); 
(b) 5 

ž=x-x¥ +27, puy(x+ 1); 
(c) 

ž=y 2x, ý=3-4y-2xy; 
(d) 

ž=-x+y -yf, ý=1-2y-xy+f; 
(e) 

ž=x-y-1, ý=y(x-2); 
(f) 

t= xry F), jap ay 
(g) 


R=4x-2x?-y?, j=l +7). 


Prove that neither of the following systems have limit cycles using the given 
multipliers: 


(a) 
f= x(4+5x42y), pay(-2+7x43y), was. 


(b) 
¥=xB-dx-yy), Y=yb-dy-cx), y=} 


In case (b), prove that there are no limit cycles in the first quadrant only. 
These differential equations were used as a general model for competing 
species in Chapter 4. 


Use the Lindstedt-Poincaré technique to obtain: 


(a) 
-t if ion for the ODE ,2 \2 
a one-term uniform expansion for the dx a ( 7 ( di) ). 
di- dt 
with initial conditions x(0) = a and (0) = O. 


(b) 
The 9 ( e) solution to the van der Pol equation: 


dx + efx _ 1) 4 ‘eaten given that x(0) = a, x(0O) = 0. 
dt 2 


Hint: Show that secular terms are removed by choosing œ% 4 = 0, a = 


2 and Sal, 
W2 = ~ 16 
(0) 
The 9 ( e?) solution to the nonlinear spring equation: 
ax 3 
—t+ex+x=0, 
dt? 


given that x(0) = b, x(O) = 0. 


Hint: Show that secular terms are removed by choosing = 3b? 
~ 8 


10. 
Using the method of multiple scales, show that the one-term uniform valid 


expansion of the ODE 


dx _ dx 
qe ae 


with initial conditions x(0) = b, x(0) = O is 


él ; 
x(t, €) ~ xmş = be 2 cos(t), 


ase > 0. 
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6. Hamiltonian Systems, Lyapunov Functions, 
and Stability 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To study Hamiltonian systems in the plane. 
e To investigate stability using Lyapunov functions. 


On completion of this chapter, the reader should be able to 


prove whether or not a system is Hamiltonian; 

sketch phase portraits of Hamiltonian systems; 

use Lyapunov functions to determine the stability of a critical point; 
distinguish between stability and asymptotic stability. 


The theory of Hamiltonian (or conservative) systems in the plane is 
introduced. The differential equations are used to model dynamical systems in 
which there is no energy loss. Hamiltonian systems are also used extensively 
when bifurcating limit cycles in the plane (see Chapters 10 and 11). 

Sometimes it is not possible to apply the linearization techniques to 
determine the stability of a critical point or invariant set. In certain cases, the 
flow across level curves, defined by Lyapunov functions, can be used to 
determine the stability. 


6.1 Hamiltonian Systems in the Plane 
Definition 1. A system of differential equations on 52 is said to be 


Hamiltonian with one degree of freedom if it can be expressed in the form 


dx _ 0H dy _ _ dH (6.1) 
dt dy? a óx?’ 


where H(x, y) is a twice-continuously differentiable function. The system is said 
to be conservative and there is no dissipation. In applications, the Hamiltonian is 
defined by 


A(x, y) = K(x, y) + V(x, y), 


where K is the kinetic energy and V is the potential energy . Hamiltonian 
systems with two degrees of freedom will be discussed in Chapter 9 


Theorem 1 (Conservation of Energy). The total energy H(x, y) is a first 
integral and a constant of the motion. 


Proof. 
The total derivative along a trajectory is given by 


dH Hdx r OH dy | 
dt Oxdt ðydt 


from the chain rule and (6.1). Therefore, H(x, y) is constant along the solution 
curves of (6.1), and the trajectories lie on the contours defined by H(x, y) = C, 
where C is a constant. 


Consider a simple mechanical system which is Hamiltonian in the plane. 

The Simple Nonlinear Pendulum. The differential equation used to model 
the motion of a pendulum in the plane (see Figure 6.1) may be derived using 
Newton’s law of motion : 

d0 g 


ae + 7 sin 6 = 0, (6.2) 


where @ is the angular displacement from the vertical, | is the length of the arm 
of the pendulum , which swings in the plane, and g is the acceleration due to 
gravity. 


Pivot 


Figure 6.1 A simple nonlinear pendulum. 


This model does not take into account any resistive forces, so once the 
pendulum is set into motion, it will swing periodically forever, thus obeying the 
conservation of energy. The system is called conservative since no energy is lost. 
A periodically forced pendulum will be discussed in Chapter 9 

Let ġ = g. Then system (6.2) can be written as a planar system in the form 


d=, = E sin 8. (6.3) 


The critical points occur at (nz, 0) in the (0, þ) plane, where n is an integer. It is 
not difficult to show that the critical points are hyperbolic if n is odd and 
nonhyperbolic if n is even. Therefore, Hartman’s theorem cannot be applied 
when n is even. However, system (6.3) is a Hamiltonian system with 

> nae 
H(6,¢) = L - $ cos 0 (kinetic energy+potential energy), and therefore the 


solution curves may be plotted. The direction field may be constructed by 
considering 1%, ġ, and ġ. Solution curves and direction fields are given in 
do 


Figure 6.2(a). 


Figure 6.2 [Python] (a) A contour plot for system (6.3) when — 47 < 8 < 4r. (b) The surface z = H(0, ©). 


The axes of Figure 6.2(a) are the angular displacement (8) and angular 
velocity (4). The closed curves surrounding the critical points (2n7, 0) represent 


periodic oscillations, and the wavy lines for large angular velocities correspond 
to motions in which the pendulum spins around its pivotal point. The closed 
curves correspond to local minima on the surface z = H(0, =), and the unstable 
critical points correspond to local maxima on the same surface. 


Definition 2. A critical point of the system 
X=f(x), xeER’, (6.4) 


at which the Jacobian matrix has no zero eigenvalues is called a 
nondegenerate critical point ; otherwise, it is called a degenerate critical point . 


Theorem 2. Any nondegenerate critical point of an analytic Hamiltonian 
system is either a saddle point or a center . 


Proof. Assume that the critical point is at the origin. The Jacobian matrix is 
equal to 


FH.) £4(0,0) 


da _ OxOy 
E 0? H 0H 
-52 0,0) -Fa (0, 0) 


Now trace(J 9) = 0 and 


OH 
OxOy 


H OH 
det(Jo) = TAK 0) ay? 


(0, 0) — ( (0, o) 
The origin is a saddle point if det(J 9) < 0. If det(J ọ) > 0, then the origin is 


either a center or a focus. Note that the critical points of system (6.1) correspond 
to the stationary points on the surface z = H(x, y). If the origin is a focus, then the 
origin is not a strict local maximum or minimum of the Hamiltonian function. 
Suppose that the origin is a stable focus, for instance. Then 


H(xo, Yo) = lim (x(t, xo, Yo), V(t, Xo, Yo)) = H(0, 0), 


for all (x o Y 9) E€ N (0, 0), where N , denotes a small deleted neighborhood of 
the origin. However, H(x, y) > H(0, 0) at a local minimum and H(x, y) < H(0, 0) 
at a local maximum, a contradiction. A similar argument can be applied when 
the origin is an unstable focus. 


Therefore, a nondegenerate critical point of a Hamiltonian is either a saddle 
point or a center. 


Example 1. Find the Hamiltonian for each of the following systems and sketch 
the phase portraits: 


(a) x= Yy = rrr: 


b) t=y+x2-y*, po—x—2xy. 


Solution. (a) Integration gives H(x,y) = y> x2 _ xæ; the solution curves are 


given by H(x, y) = C. There are two critical points at (0, 0) and (—1, 0), which are 
both nondegenerate. The critical point at the origin is a saddle point or col from 
linearization, and the eigenvectors are (1, -1)! and (1, 1). The critical point at 
(—1, 0) is a center from Theorem 1. If y > 0, then x > 0, andif y <0, then x < 0 


. A phase portrait is given in Figure 6.3. 
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Figure 6.3 A phase portrait for Example 1(a). 


(b) Integration gives C ; the solution curves are 
A(x,y) = > + 


Z; 
3 


given by H(x, y) = C. There are four critical points at O = (0, 0), A = (0, 1), 
ga ( 3 ) and C= | V3 ) which are all nondegenerate. The critical 
2> 2 7 2 


2? 2? 


point at the origin is a center by Theorem 1, and the critical points at A, B, and C 
are saddle points or cols from linearization. The eigenvectors determine the 
stable and unstable manifolds of the cols. The eigenvectors for point A are 


(1, v3)" and (1, — e the eigenvectors for B are (1, — v3)? and (1, 0)!; 
and the eigenvectors for C are (1, 0)! and ‘a V3)": The solution curves and 
direction fields are shown in Figure 6.4. 


Definition 3. Suppose that x y is a critical point of system (6.4). If A *(y) =A 


~(y) =X 9, then y is a homoclinic orbit . 


An example of a homoclinic orbit is given in Figure 6.3. The unstable and stable 
manifolds from the origin form a homoclinic loop around the critical point at 
(-1, 0). A homoclinic orbit connects a critical point to itself and takes an infinite 
amount of time to make the connection. 
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Figure 6.4 A phase portrait for Example 1(b). The lines y= -4> y=- V3x4+1? and y= V3x+1 


are invariant. 


Definition 4. Suppose that x 9 and y g are distinct critical points. If A *(y) =x 9 
and A (y) = y 9, then y is called a heteroclinic orbit . 


Examples of heteroclinic orbits are given in Figure 6.4. They are the three orbits 


lying on the line segments ly = _1 NB Sga 3, 
Too g o 2 


fy = —VBx+1,-B < x< Bp ane ty = V3x41,-B < x< É) 


Definition 5. A separatrix is an orbit that divides the phase plane into two 
distinctly different types of qualitative behavior. The homoclinic and 


heteroclinic orbits are examples of separatrix cycles. 


For example, in Figure 6.3, orbits are bounded inside the homoclinic orbit 
surrounding the point(—1, 0) and unbounded outside it. 


6.2 Lyapunov Functions and Stability 


Consider nonlinear systems of the form (6.4). The stability of hyperbolic critical 

points may be determined from the eigenvalues of the Jacobian matrix. The 

critical point is stable if the real part of all of the eigenvalues is negative and 

unstable otherwise. If a critical point is nonhyberbolic , then a method due to 

Lyapunov may sometimes be used to determine the stability of the critical point. 
Imagine a system defined by the potential function V (x, y), where 


The negative signs arise from the analogies with potential energy from physics. 
Now 


av _aVdx Vdr (av)? (VÝ o 
dt Oxdt odydt  \ðx Oy} ~ 


This implies that V (t) decreases along trajectories and the motion is always 
toward lower potentials. Now x = ý = 0 when a = L = (), corresponding to 
x oy 


local maxima, minima, or saddle points on V (x, y). Local maxima correspond to 
unstable critical points, and local minima correspond to stable critical points. 


Example 2. Plot a phase portrait for the system y = y — x’, ý = —y, and plot 
the potential function for this system. 


Solution. There are three critical points at O = (0, 0), A = (-1, 0), and B = (1, 0). 
The origin is unstable and the critical points A and B are stable, as seen in 
Figure 6.5(a). The function z = V(x, y) = -x ?⁄2 + x 4⁄4 + y %, plotted in 

Figure 6.5(b), is known as the double-well potential . The system is multistable 
since it has two stable critical points. 
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Figure 6.5 (a) A phase portrait for Example 2. (b) The double-well potential. 


The local minima in Figure 6.5(b) correspond to the stable critical points at A 
and B. The local maximum at the origin corresponds to the saddle point in 
Figure 6.5(a). 


Definition 6. A critical point, say, x 9, of system (6.4) is called stable if given 
£ > 0 there is ad > 0 such that for all t > t 9, X(t) -x 9(t) Il < £ whenever IIx(t 9) 
-X 9(t o) Il < 8, where x(t) is a solution of (6.4). 


Definition 7. 
A critical point, say, X 9, of system (6.4) is called asymptotically stable if it is 


stable and there is an 7 > 0 such that 
lim || xX) — xo(¢) ||= 9, 
t— œ 
whenever |Ix(t 9) -x 9(t o Il <n. 
A trajectory near a stable critical point will remain close to that point, whereas a 
trajectory near an asymptotically stable critical point will move closer and closer 


to the critical point as t > œ. 
The following theorem holds for system (6.4) when x € R”. Examples in 


%3 are given in Chapter 8 


The Lyapunov Stability Theorem. Let E be an open subset of R” 


containing an isolated critical point x g . Suppose that f is continuously 


differentiable and that there exists a continuously differentiable function, say, V 
(x ), which satisfies the conditions: 


e V(X 9) =0; 
e V(x) >0, ifx 7X9, 


where x € R”. Then 


1. 
if V(x) < 0 for all x € E, x 9 is stable; 


2. 
if V(x) < 0 for all x € E, x 9 is asymptotically stable; 


3. 
if V(x) > 0 for all x € E, x 9 is unstable . 


Proof. 1. Choose a small neighborhood N , surrounding the critical point x 9. 
In this neighborhood, V(x) < 0, so a positive semiorbit starting inside N , 


remains there forever. The same conclusion is drawn no matter how small € is 
chosen to be. The critical point is therefore stable. 
2. Since V(x) < 0, the Lyapunov function must decrease monotonically on 


every positive semiorbit x(t). Let Ọ , be the flow defined by f(x). Then either V 
(0 ,.) > Xq ast > œ or there is a positive semiorbit x(t) such that 


Vid, >n>O0, forall t> to, (6.5) 


for some n > 0. Since x g is stable, there is an annular region A, defined by n < V 
(x) < c, containing this semiorbit. Suppose that y attains its upper bound in A, 


say, — N, so 


Vix)<-N <0, xeEA, N>O. 
Integration gives 
V(x(t)) — V(x(to)) < —N(t — to), 


where t > t ọ. This contradicts (6.5), and therefore no path fails to approach the 
critical point at x 9. The critical point is asymptotically stable. 
3. Since V(x) > 0, V(x) is strictly increasing along trajectories of (11.4). If @ , 


is the flow of (11.4), then 
Ví) > V(x) > O 
for t > 0 in a small neighborhood of x 9, N ,. Therefore, 
V$) — V(xo) > kt 
for some constant k and t > 0. Hence for sufficiently large t, 
V(ġ)>kt>K, 


where K is the maximum of the continuous function V (x) on the compact set N. 
. Therefore, @ , lies outside the closed set N , and x 9 is unstable. 


Definition 8. The function V (x) is called a Lyapunov function . 
Unfortunately, there is no systematic way to construct a Lyapunov function. The 
Lyapunov functions required for specific examples will be given in this book. 
Note that if V(x) = 0, then all trajectories lie on the curves (surfaces in R”) 
defined by V (x) = C, where C is a constant. The quantity y gives the rate of 
change of V along trajectories, or in other words, \ gives the direction that 


trajectories cross the level curves V (x) = C. 


Example 3. 
Determine the stability of the origin for the system 


à . 3 
k=-y, yar. 


Solution. The eigenvalues are both zero and the origin is a degenerate critical 
point. A Lyapunov function for this system is given by V(x, y) = x 4 + y 4, and 
furthermore 

dV OVdx 0Vdy 


Se nee = 4,3(-? 4y3(x°) = 0. 
dt sdi opdi PE TE 


Hence the solution curves lie on the closed curves given by x 4 + y 4 = C. The 
origin is thus stable but not asymptotically stable. The trajectories that start near 
to the origin remain there but do not approach the origin asymptotically. If y > 0, 
then x < 0, and if y <0, then x > 0. The level curves and direction fields are 


given in Figure 6.6. 


Example 4. 
Investigate the stability of the origin for the system 


x=y, y=-x-y(1-x’) 
using the Lyapunov function V (x, y) =x? +y?. 


Solution. Now 
dV OVdx OVdy | 5 
— L 1 = — 2 ) a (— — y 
aa a 


sO 
dV 


— = 2y 2] 
dt ye ) 


and y < 0if|x |< 1. Therefore, y = 0, if either y = 0 or x = +1. When y = 0, 


x = 0 and y = —x, which means that a trajectory will move off the line y = 0 


when x # 0. Hence if a trajectory starts inside the circle of radius one centered at 
the origin, then it will approach the origin asymptotically. The origin is 
asymptotically stable. 


Figure 6.6 A phase portrait for Example 3. 
Definition 9. Given a Lyapunov function V (x, y), the Lyapunov domain of 
stability is defined by the region for which Y(x, y) < 0. 
Example 5. 
Prove that the origin of the system 
k= 8x- xy -3y, p= 22’y 4+ 2x 


is asymptotically stable using the Lyapunov function V (x, y) = 2x ° + 3y °. 
Determine the Lyapunov domain of stability based on V (x, y). 


Solution. Now 
V = 4x(-8x — xy* — 3y’) + 6y(2x’y + 2xy’) = 8x7(y* — 4) 
and Ų < Qif|y|<2. Therefore, y = 0 if either x = 0 or y = +2. When x = 0, 


x = —3y and y = 0, which means that a trajectory will move off the line x = 0 


when y #0. Now y < (if |_y|< 2. This implies that y < 0 as long as V (x, y) = 


2x * + 3y * < 12. This region defines the domain of Lyapunov stability. 
Therefore, if a trajectory lies wholly inside the ellipse 2x ? + 3y ? = 12, it will 
move to the origin asymptotically. Hence the origin is asymptotically stable. 
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Figure 6.7 (a) A phase portrait for Example 5. (b) The domain of Lyapunov stability. 


An approximation of the true domain of stability for the origin of the system 
in Example 5 is indicated in Figure 6.7(a). Notice that it is larger than the 
Lyapunov domain of stability (Figure 6.7(b)) and that the x-axis is invariant. 


Example 6. 
Consider the system defined by: 
dx 


dy 

2 2 2 
— = -x+y +2x, —=-yty. 
dt . dt Í 7 


Prove that the origin is asymptotically stable within a suitable basin of attraction. 
Determine this basin of attraction given that V (x, y) = x ? + y ° is a suitable 


Lyapunov function. 
Solution. Now 

V = (2x)(—x + y? + 2x”) + y\(-y + y?) =2 (7-1 2day =li x) l 
Therefore, L < Q0, aslongas y < 1 and y < 1 — x. Plotting these lines, it is not 


difficult to see that the basin of attraction is estimated by V(x, y) < L. 


Example 7. 
A suitable Lyapunov function for the recurrent Hopfield network modeled using 
the differential equations 


2 Ç 2 ) 
ž= -x+ 2|% tan! (= , y=-yt2 Z tan”! (=) F 
T 2 T 2 


is given by 


V (aj,@2) = — (a; + a3) — 4 (In (cos (=) + In (cos (=) 


where 


2 : 2 ) 
a,(f) = —tan* (= and a(t) = = tan! (=). 
T 2 T 2 


Set y = 0. 7. A vector field plot for the recurrent Hopfield network is given in 
Chapter 20 There are nine critical points, four are stable and five are unstable. 
Plot the function V (a1, a2) and the corresponding contour plot when | a ;| < 1,1 


= 1, 2. Continuous Hopfield models are discussed in Chapter 20 


Solution. Figure 6.8(a) shows the surface plot V (a), a2) when y = 0. 7, there is 


one local maximum and there are four local minima. Figure 6.8(b) shows the 
corresponding contour plot. 


Contour plot 
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Figure 6.8 The Lyapunov function V (a,, a7) when y = 0. 7. (a) Surface plot; (b) contour plot. 


6.3 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


lmeshgrid  |# Return coordinate matrices from 


[Peeorinate vectors. 
ravel | # Return a contiguous flattened array. 


# Program 06a: Contour plot. See Figure 6.2(a). 
import numpy as np 

import matplotlib.pyplot as plt 

xlist np.linspace(-10.0, 10.0, 100) 
ylist np.linspace(-4.0, 4.0, 100) 
X, Y = np.meshgrid(xlist, ylist) 

Z= Y **2/2 - 5 * np.cos(X) 
plt.figure() 

plt.contour(X, Y, Z) 
plt.xlabel(r’$\theta$’, fontsize=15) 
plt.ylabel(r’$\phi$’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.show() 


# Program 06b: Surface plot of Hamiltonian. See Fi 
gure 6.2(b). 

import numpy as np 

import matplotlib.pyplot as plt 

from mpl_toolkits.mplot3d import Axes3D 

def fun(x, y): 

return y ** 2 / 2 - 5 * np.cos(x) 

fig = plt.figure() 

ax = fig.add_subplot(111, projection = ’3d’) 
x = np.arange(-10.0, 10.0, 0.1) 
y np.arange(-4.0, 4.0, 0.1) 

X, Y = np.meshgrid(x, y) 

ZS = np.array([fun(x,y) for x, y in zip(np.ravel(X) 
, np.ravel(Y))]) 

Z = zs.reshape(X.shape) 

ax.plot_surface(X, Y, Z) 

ax.set_xlabel(r’$\theta$’, fontsize=12) 

ax.set_ylabel(r’$\phi$’, fontsize=12) 

ax.set_zlabel(r’$H(\theta, \phi)$’, fontsize=12) 

plt.tick_params(labelsize=12) 

ax.view_init(30, -70) 

plt.show() 


6.4 Exercises 


Find the Hamiltonian of the system 


a y, y = x— x 
and sketch a phase portrait. 


Given the Hamiltonian function _y x2 xt, sketch a phase 
H (x, y) a 3 + 


x 
2 A 
portrait for the Hamiltonian system. 


Plot a phase portrait for the damped pendulum equation 


Ö +0.15 + sin0 = 0 


eee) See 2 AE T MS ee: ee Se Y PEN 


ana describe wnat nappens pnysically. 
Plot a phase portrait of the system 


g=yy-1), y=x(1-2°). 


Investigate the stability of the critical points at the origin for the systems: 

(a) 5 
ž = —y — xX, ý = x — y> using the Lyapunov function V (x, y) = x 
+y% 


(b) 


X= x(x — æ), ý = y(y — £), using the Lyapunov function 


sa 
(c) 


ž = y ý = y — x°, using the Lyapunov function V (x, y) = ax * + bx ? 
+ cxy + dy ?. 
Prove that the origin is a unique critical point of the system 
x= -50 tian =A a Pen oy Se Ey, 


Determine the stability of the origin using the Lyapunov function V (x, y) = 
(1 - 4x? - y *)*. Find A *(p) for each p € 92. Plot a phase portrait. 


Determine the values of a for which V (x, y) = x ? + ay ? is a Lyapunov 
function for the system 


kao-x+y-xr-y +x, po-ytxu-y-ery. 


Determine the basin of attraction of the origin for the system 


tax t+y-4)-y, paxtyoe+y?-4) 
using the Lyapunov function V (x, y) =x? +y °. 


Plot a phase portrait for the system in Exercise 8. 


10. 
Consider the system: 


fe = yrr Jnr 


Prove that the origin is asymptotically stable. For suitable A and B, in the 


Lyapunov function V (x, y) = x ? + Axy + By 2, determine the basin of 
attraction. Use Python to plot a phase portrait and the basin of attraction. 
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7. Bifurcation Theory 
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Aims and Objectives 


e To introduce bifurcation theory of continuous systems in the plane. 

e To introduce the notion of steady-state solution and investigate multistability 
and bistability. 

e To introduce the theory of normal forms. 


On completion of this chapter, the reader should be able to 


describe how a phase portrait changes as a parameter changes; 
animate phase portraits and plot bifurcation diagrams; 

take transformations to obtain simple normal forms; 

interpret the bifurcation diagrams in terms of physical behavior. 


If the behavior of a dynamical system changes suddenly as a parameter is 
varied, then it is said to have undergone a bifurcation. At a point of bifurcation, 
stability may be gained or lost. 

It may be possible for a nonlinear system to have more than one steady-state 
solution. For example, different initial conditions can lead to different stable 
solutions. A system of this form is said to be multistable. Bifurcations of the so- 
called large-amplitude limit cycles are discussed. By introducing a feedback 
mechanism into the system it is possible to obtain hysteresis, or bistable 
behavior. 


7.1 Bifurcations of Nonlinear Systems in the Plane 
Definition 1. A vector field f e 932, which is continuously differentiable, is 


called structurally stable if small perturbations in the system x = f(x) leave the 


qualitative behavior unchanged. If small perturbations cause a change in the 
qualitative behavior of the system, then f is called structurally unstable . 


For example, the Lotka-Volterra model (Example 2, Chapter 4) is structurally 
unstable, while the Holling-Tanner model (Example 3, Chapter 4) is structurally 
stable. 

Peixoto’s Theorem in the Plane . Let the vector field f be continuously 
differentiable on a compact set, say, D. Then f is structurally stable on D if and 


only if 
e the number of critical points and limit cycles is finite and each is hyperbolic; 
e there are no trajectories connecting saddle points to saddle points. 


Consider systems of the form 
x = f(x, p), (7.1) 


where x e R? and u € R. A value, say, H o, for which the vector field f(x, p 


o) is not structurally stable is called a bifurcation value . 


Four simple types of bifurcation, all at nonhyperbolic critical points, will be 
given in order to illustrate how the qualitative behavior of a structurally unstable 
system of differential equations can change with respect to a parameter value. 
Certain bifurcations can be classified by the so-called normal forms . By finding 
suitable transformations it is possible to reduce systems to a normal form. 
Schematic diagrams depicting four normal form bifurcations are illustrated 
below, and the theory of normal forms is introduced in the next section along 
with some simple examples. The example bifurcations are presented in the plane 
rather than on the line to give the reader more practice at plotting phase portraits. 


7.1.1 A Saddle-Node Bifurcation 


Consider the system 
k=p-x, yo-y. (7.2) 
The critical points are found by solving the equations x = y = 0. There are 


(i) zero, (ii) one, or (iii) two critical points, depending on the value of u. 
Consider the three cases separately. 
Case (i). When u < 0, there are no critical points in the plane and the flow is 


from right to left since x < 0. If y > 0, then ý < 0 and ify <0, then y > 0. A 


plot of the vector field is given in Figure 7.1(a). Note that the flow is invariant 
on the x-axis. 

Case (ii). When p = 0, there is one critical point at the origin and it is 
nonhyperbolic. The solution curves may be found by solving the differential 
equation 

dy _y_y 


dx x x 


This is a separable differential equation (see Chapter 2) and the solution is given 
by |= K e-+,» Where K is a constant. Note that x < O for all x. The vector field 


is plotted in Figure 7.1(b). Note that the flow is invariant along both the x-axis 
and the y-axis. 
Case (iii). When p > 0, there are two critical points at A = ( y/u, 0) and 


B = (— yp, 0). Linearize in the usual way. The Jacobian matrix is given by 


OP OP 
J=- ax ay | —2x 0 
2g 2g oe eir 


o ôx dy 


where x = P(x, y) and ý = Q(x, y). Therefore, 


and the eigenvalues and eigenvectors are given by A; = —2 Vue (4, 0)! anda 


> = —1, (0, 1)". The critical point at A is thus a stable node and the stable 
manifolds are orthogonal to one another. 
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Figure 7.1 Vector field plots and manifolds when (a) u < 0, (b) u = 0, and (c) p > 0. There are no 


manifolds when p < 0. 


0 


Figure 7.2 A schematic of a bifurcation diagram for system (7.2) showing a saddle-node bifurcation. The 
solid curves depict stable behavior and the dashed curves depict unstable behavior. 


The Jordan matrix for the critical point at B is 


(NS) 


and the eigenvalues and eigenvectors are A; = 2 ya , (1, 0)? anda ,=-1, 


(0, 1)". This critical point is a saddle point. The vector field and orthogonal 
stable and unstable manifolds are plotted in Figure 7.1(c). 

In summary, there are no critical points if p is negative; there is one 
nonhyperbolic critical point at the origin if u = 0; and there are two critical 
points—one a saddle and the other a node—when rp is positive. The qualitative 
behavior of the system changes as the parameter p passes through the bifurcation 
value 4 9 = 0. The behavior of the critical points can be summarized on a 


bifurcation diagram as depicted in Figure 7.2. 

When u < 0, there are no critical points, and as u passes through zero the 
qualitative behavior changes and two critical points bifurcate from the origin. As 
u increases, the critical points move farther and farther apart. Note that the 
critical points satisfy the equation p = x *, hence the parabolic form of the 
bifurcation curve . More examples of saddle-node bifurcations are given in 
Section 7.3. 


7.1.2 A Transcritical Bifurcation 
Consider the system 


k=px-x, y=-y. (7.3) 


The critical points are found by solving the equations x = y = 0. There are 


either one or two critical points depending on the value of the parameter p. The 
bifurcation value is again u ọ = 0. Consider the cases (i) p < 0, (ii) p = 0, and (iii) 
u > 0 separately. 

Case (i). When u < 0, there are two critical points, one at O = (0, 0) and the 
other at A = (u, 0). The origin is a stable node and A is a saddle point. A vector 
field and manifolds are plotted in Figure 7.3(a). 

Case (ii). When p = 0, there is one nonhyperbolic critical point at the origin. 
The solution curves satisfy the differential equation 

dy y 


dx <x? 


which has solutions ly} = K e-+» where K is a constant. A vector field and the 


manifolds through the origin are shown in Figure 7.3(b). 
Case (iii). When p > 0, there are two critical points, one at O = (0, 0) and the 


other at B = (u, 0). The origin is now a saddle point and B is a stable node. A 
vector field and manifolds are plotted in Figure 7.3(c). 

The behavior of the critical points can be summarized on a bifurcation 
diagram as depicted in Figure 7.4. 


7.1.3 A Pitchfork Bifurcation 
Consider the system 


ž=ux-x, pay. (7.4) 
The critical points are found by solving the equations x = y = 0. There are 


either one or three critical points depending on the value of the parameter p. The 
bifurcation value is again u ọ = 0. Consider the cases (i) p < 0, (ii) p = 0, and (iii) 
u > 0, separately. 

Case (i). When p < 0, there is one critical point at O = (0, 0). The origin is a 
stable node. A vector field and the manifolds at the origin are shown in 
Figure 7.5(a). 

Case (ii). When p = 0, there is one nonhyperbolic critical point at the origin. 
The solution curves satisfy the differential equation 
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Figure 7.3 Vector field plots and manifolds when (a) u < 0, (b) u = 0, and (c) u > 0. 


0 u 


Figure 7.4 A bifurcation diagram for system (7.3) showing a transcritical bifurcation. The solid lines 
depict stable behavior and the dashed lines depict unstable behavior. 


which has solutions re Keone? where K is a constant. A vector field is plotted 


in Figure 7.5(a). 
Case (iii). When p > 0, there are three critical points at O = (0, 0), 
A = ( yu, 0), and B = (— ya, 0). The origin is now a saddle point and A and B 


are both stable nodes. A vector field and all of the stable and unstable manifolds 
are plotted in Figure 7.5(b). 
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Figure 7.5 Vector field plots and manifolds when (a) u < 0 and (b) p > 0. 
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The behavior of the critical points can be summarized on a bifurcation 


diagram as depicted in Figure 7.6. 


0 


u 


Figure 7.6 A schematic of a bifurcation diagram for system (7.4) showing a pitchfork bifurcation. The 


solid curves depict stable behavior and the dashed curves depict unstable behavior. Note the resemblance of 
the stable branches to a pitchfork. 


7.1.4 A Hopf Bifurcation 
Consider the system 


r=r(u-r’), @=-1. (7.5) 
The origin is the only critical point since g + 0. There are no limit cycles if 


(i) u < 0 and one if (ii) u > 0. Consider the two cases separately. 
Case (i). When p < 0, the origin is a stable focus. Since ġ < 0, the flow is 


clockwise. A phase portrait and vector field are shown in Figure 7.7(a). 
Case (ii). When p > 0, there is an unstable focus at the origin and a stable 
limit cycle at y = y/u since r>OifdQ<r< ju and r<OQOifr> Vu. A 


phase portrait is shown in Figure 7.7(b). 

The qualitative behavior can be summarized on a bifurcation diagram as 
shown in Figure 7.8. As the parameter p passes through the bifurcation value p 9 
= 0, a limit cycle bifurcates from the origin. The amplitude of the limit cycle 
grows as pl! increases. Think of the origin blowing a smoke ring. The program for 
an animation of a Hopf bifurcation is listed in Section 7.4. 
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Figure 7.7 [Python animation] Phase portraits when (a) p4 < 0 and (b) p > 0. 


7.2 Normal Forms 


This section introduces some basic theory of normal forms without any rigorous 
justification. To keep the theory simple, the author has decided to illustrate the 
method for planar systems only. Note that the theory can be applied to n- 
dimensional systems in general, see [2, 9], and [10]. The theory of normal forms 
began with Poincaré and Dulac and was later applied to Hamiltonian systems by 
Birkhoff. 


Figure 7.8 A schematic of a bifurcation diagram for system (7.5) showing a Hopf bifurcation. The solid 
curves depict stable behavior and the dashed curves depict unstable behavior. 


The basic idea is to take nonlinear transformations of the nonlinear system 
x = X(x), to obtain a linear system ù = Ju, where X(0) = 0, (x Xue ne) 


and J is a Jacobian matrix (see Section 3.4). The nonlinear terms are removed in 
a sequential manner starting with the quadratic terms. Of course, it is not always 
possible to obtain a linear system. In the majority of cases, one has to be 
satisfied with a “simplest” possible form, or normal form, which may not be 
unique. Normal forms are useful in the study of the local qualitative behavior of 
critical points and bifurcation problems. 

In order to keep the explanations simple we will start by trying to eliminate 
the quadratic terms of a planar system. Suppose that 


w = Aw + Hy(w) + O (Iw}), 


(7.6) 
where w e R2, H 5 is a homogeneous polynomial vector of degree two, A is a 2 


x 2 matrix, and o (Iwp) denotes higher order terms. Let w = P x, then system 


(7.6) becomes 
På = APx + Ha(Px) + O(|xl’) 
and multiplying by P ~t 
x = Jx + ho(x) + O (xf). (7.7) 


where P is such that J = P “t AP is a Jacobian matrix, and h (x) = P ~t H ‚(P x) 
is a homogeneous vector of degree two. Take a transformation of the form 
x = u + f,(u) + O (luf), (7.8) 
Substitute (7.8) into (7.7). Thus 
ú + Df,(uyu + O (lu?) ù = J (u + f(a) + O (lu? )) + 


h> (u +6U)+O C) +0 (Iu!) 


where D is the matrix of partial derivatives, an explicit example is given below. 
Now h, (u + £(u)) = ho(u) + O (lu?) and ù = Ju+O (lu?) therefore 


ù = Ju - (Dfx(w)Ju — Jf(u)) + hp(u) + O (luf). (7.9) 


Equation (7.9) makes it clear how one may remove the quadratic terms by a 
suitable choice of the homogeneous quadratic polynomial f 5. To eliminate the 


quadratic terms one must find solutions to the equation 
Df>(u)Ju — Jf(u) = ho(u). (7.10) 
The method of normal forms will now be illustrated by means of simple 


examples. 


Example 1. 
Determine the nonlinear transformation which eliminates terms of degree two 
from the planar system 


; 2 . > (7.11 
* = Ax + aX + a] 1 Xy + anny’, y= Ary ate baoz? J bi xy + boy’, ( ) 
where A 12 # 0. 


Solution. Now 


and 


-g 
i) 
AN 
>í 
N- 
II 
a 
= > 
‘Ss 
See 
II 


An9Xx" + ayixy + any” 
bax? + Dixy + boy? J 


also 


frou? + fijuv + fov? 


fio 
f- = = : 
ou) | f2 gu + guv + goav’ 


Equating coefficients of u °, uv, and v *, equation (7.10) can be written in the 
matrix form 


MF =H 
or more explicitly 
Ay 0 0 0 0 0 fo 230 
0 A2 0 0 0 0 fi dil 
0 0 2A> = Ay 0 0 0 fo _ ag? 
0 O 0 2A, = Ay 0 0 820 g bo 
0 0 0 0 A, 0 &1l bii 
0 0 0 0 0 A2 802 bo? 


The inverse of matrix M exists if and only if all of the diagonal elements are 
nonzero. The computations above may be checked with Python. 


Definition 2. The 2-tuple of eigenvalues (41,42) is said to be resonant of 


order 2 if at least one of the diagonal elements of M is zero. 


Therefore, if none of the diagonal elements of M are zero 


9 an ay? by 


= Ji = for = DA,’ g% = 


fo = Ai | = w 


e =, sit = 


l — 
—, £02 = 
l 


by 
Ay 


and all of the quadratic terms can be eliminated from system (7.11) resulting in a 


linear normal form u = Ju. 


Example 2. 


Find the change of coordinates of the form x = u + f ,(u) which transforms the 


system 


into the form 


Transform the system to verify the results. 
Solution. Using the results from Example 1, f 5) = 1, and 
CSUs, Yav 
Differentiating with respect to time gives 
x=u+2uu, y=v. 
Therefore 


x. 5x + 5x? 


= ——__ = . LS y= 3S v. 
1+2u 1+2u ° 7 


ù 
Now, taking a Taylor series expansion about u = 0, 


1 
] + 2u 


=1-2u+4u?-8u°+O (uć) , 


and 


5x + 5x? = 5(u + u?) + 5(u + u? = 5u + 10u? + 10u? + O (u). 


(7.12) 


(7.13) 


1 heretore 
ù = Su(1 + 2u + 2u? + O(w*))(1 - 2u + 44? + O(u’)), è = 3v. 
Finally, the linearized system is 
a= 5u+O(u), = 3». 


Note that in general, any terms that cannot be eliminated are called 
resonance terms, as the third example demonstrates. 


Example 3. 
Determine the normal form of the following system with a nonhyperbolic critical 
point at the origin. 


(An 0) (2) 5. (aan Paina aay + O (Ixl?) 7.14 
y Z 0 0 y bax? + by xy + boy” : (7. ) 


where A , #0. 


Solution. Referring to Example 1, in this case A 5 = 0, and the zero elements in 
matrix M are in the second and sixth rows. Therefore there are resonance terms, 
auv and by °, and the normal form of equation (7.14) is given by 


(al (0 oho Je oe} ol) 


7.3 Multistability and Bistability 


There are two types of Hopf bifurcation, one in which stable limit cycles are 
created about an unstable critical point, called the supercritical Hopf bifurcation 
(see Figure 7.8), and the other in which an unstable limit cycle is created about a 
stable critical point, called the subcritical Hopf bifurcation (see Figure 7.9). 


Figure 7.9 A schematic of a bifurcation diagram showing a subcritical Hopf bifurcation. The solid curves 
depict stable behavior and the dashed curves depict unstable behavior. 


In the engineering literature, supercritical bifurcations are sometimes called 
soft (or safe ); the amplitude of the limit cycles build up gradually as the 
parameter, u in this case, is moved away from the bifurcation point. In contrast, 
subcritical bifurcations are hard (or dangerous ). A steady state, say at the 
origin, could become unstable as a parameter varies and the nonzero solutions 
could tend to infinity although they are more likely to tend towards another 
finite-amplitude attractor in applications. An example of this type of behavior 
can be found in Figure 7.9. As u passes through zero from positive to negative 
values, the steady-state solution at the origin becomes unstable and trajectories 
starting anywhere other than the origin would tend to infinity. 

It is also possible for limit cycles of finite amplitude to suddenly appear as 
the parameter p is varied. These limit cycles are known as large-amplitude limit 
cycles . Examples of this type of behavior include surge oscillations in axial flow 
compressors and wing rock oscillations in aircraft flight dynamics; see [8] for 
examples. Generally, unstable limit cycles are not observed in physical 
applications, so it is only the stable large-amplitude limit cycles that are of 
interest. These limit cycles can appear in one of two ways; either there is a jump 
from a stable critical point to a stable large-amplitude limit cycle or there is a 
jump from one stable limit cycle to another of larger amplitude. These 
bifurcations are illustrated in the following examples. 

Large-Amplitude Limit Cycle Bifurcations. 

Consider the system 


r=oruter—r'), @=-1. (7.15) 


The origin is the only critical point since ġ + (). This critical point is stable 


if u < 0 and unstable if u > 0. The system undergoes a subcritical Hopf 
bifurcation at p = 0 as in Figure 7.9. However, the new feature here is the stable 
large-amplitude limit cycle which exists for, say, [> Us = —i. In the range H s 


< u < 0, there exist two different stable solutions; hence system (7.15) is 
multistable in this range. The choice of initial conditions determines which 
stable limit cycle will be approached as t > œ. 


Definition 3. A dynamical system, say (7.1), is said to be multistable if there 
is more than one possible stable attractor solution (including steady states, limit 
cycles, and strange attractors (see Chapter 8)) for a fixed value of the parameter 
u. The stable attractor obtained depends on the initial conditions. 


The existence of multistable solutions allows for the possibility of bistability (or 
hysteresis) as a parameter is varied. The two essential ingredients for bistable 
behavior are nonlinearity and feedback . To create a bistable region there must 
be some history in the system. Bistability is also discussed at some length in 
Chapter 16 when investigating nonlinear optical fiber resonators. Suppose that 
the parameter p is increased from some value less than p s. The steady state 


remains at r = 0 until u = 0, where the origin loses stability. There is a sudden 
jump (a subcritical Hopf bifurcation) to the large-amplitude limit cycle, and the 
steady state remains on this cycle as p is increased further. If the parameter p is 
now decreased, then the steady state remains on the large-amplitude limit cycle 
until u = pt çs, where the steady state suddenly jumps back to the origin (a saddle- 


node bifurcation of a limit cycle) and remains there as p is decreased further. In 
this way a bistable region is obtained as depicted in Figure 7.10. 


Hs 0 H 


Figure 7.10 A schematic of a bifurcation diagram depicting bistable behavior for system (7.15). 


Definition 4. A dynamical system, say (7.1), has a bistable solution if there 
are two stable states for a fixed parameter p and the steady state obtained 
depends on the history of the system. 


Now consider the system 
For(u-0.28P+r-r7). G=-1. (7.16) 


A bistable region may be obtained by increasing and then decreasing the 
parameter p as in the example above. A possible bifurcation diagram is given in 
Figure 7.11. In this case, there is a supercritical Hopf bifurcation at u = 0 and 
saddle-node bifurcations of limit cycles at u g and p 4, respectively. 

Jumps between different stable states have been observed in mechanical 
systems . Parameters need to be chosen which avoid such large-amplitude limit 
cycle bifurcations, and research is currently underway in this respect. 

Bistability also has many positive applications in the real-world; for 
example, nonlinear bistable optical resonators are investigated in Chapter 16. 
The author is also currently investigating multistability and bistability in a wide 
range of disciplines, including biology. 

A Saddle-Node on an Invariant Cycle (SNIC) Bifurcation. In this case, a 
limit cycle bifurcates on an invariant cycle as a saddle point and a stable node 
collide. This type of bifurcation is best illustrated by means of an example. 


Figure 7.11 A schematic of a bifurcation diagram depicting bistable behavior for system (7.16). 


Example 4. 
Consider the system: 


dx 5 dy 6) 9) 
— = x(1 -x°-y’)-y(I +y+X), == (I -x°-y’)+x(1 +y+ x), 


where y is a constant. Convert this system to polar form and show that the 
system has three critical points for — 2 < y < 0, and one critical point and one 
limit cycle if either, y > 0, or if y < —2. Determine the stability of the critical 
points, use Python to produce an animation of the phase portrait and plot a 
bifurcation diagram as y increases from y = -3 toy = 1. 


Solution. Converting to polar coordinates one obtains: 
f= r(1 -r), Ô = 1 +y + rcos(ð). 


The origin O = (0, 0) is a critical point and there are an additional two critical 
points at 4 — (1 cos7!(-1 — y) and p = (1 ~cos7!(-1 - y)): The Jacobian 


matrix is: 


_{1-3r 0 
~ \ cos(@) —rsin(@) J 
When - 2 < y < 0, there is an invariant circle with a saddle point and a stable 


node which collide and vanish when either y = —2 or y = 0. The origin is unstable 
as, 7 > 0, for 0 <r < 1, the critical point at A is a saddle point as 


det (J4) = -2 41 - (y+ 12 <0 and the critical point at B is stable as 


trace (Jp) = -2 — 241 — (y + 1)? < 0, det (Jp) = 2 41 -(v + 1)? > 0: 


When y> 0 or y < —2, there is a stable limit cycle of radius one and one unstable 
critical point at the origin. Figure 7.12 shows a schematic of a saddle-node 
invariant cycle bifurcation diagram for Example 4 and a Python program 
showing an animation of the bifurcation is listed in the next section. 


Figure 7.12 [Python animation] A schematic of a bifurcation diagram showing a saddle-node invariant 
cycle (SNIC) bifurcation. The solid red curves depict stable critical points, the dashed red curves denote 
unstable critical points, and the blue dots represent a stable limit cycle. 


7.4 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


ArtistAnimation|# Animation using a fixed set of 


Artist objects. 


lblit=-True | # Only redraw the parts 


FuncAnimation 


# Makes an animation by 


repeatedly calling 


# a function func. 


that have changed. 


# Program 07a: Animation of a simple curve. Saddle- 
node bifurcation. 

# See Figure 7.2. 

# Animation of mu- 
x**2, aS mu increases from mu=-3 to mu=3. 

# Type - %matplotlib qt5 - in IPython Console windo 
W. 


import numpy as np 
from matplotlib import pyplot as plt 
from matplotlib.animation import FuncAnimation 


xmin, xmax = -4, 4 
mu_min, mu_max = -3, 3 


# Set up the figure. 

fig = plt.figure() 

ax = plt.axes(xlim=(xmin, xmax), ylim=(xmin, xmax)) 
line, = ax.plot([], [], lw=2) 
ax.plot([xmin, xmax], [0, 0], ‘m’) 
ax.plot([0, 0], [xmin, xmax], ‘’m’) 


def init(): 
line.set_data([], []) 
return line, 


# Animate mu-x4**2, where -3<mu<3. 
def animate(mu): 
x = np.linspace(mu_min, mu_max, 100) 
y = mu - x**2 
line.set_data(x, y) 
return line, 


bifurcation = animation.FuncAnimation(fig, animate, 
init_func=init, \ 
frames=np.linspace(mu_min, mu_max, 1000), 
interval=10, blit=True) 


plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 


plt.show() 


# Program 07b: Animation of a subcritical Hopf bifu 
rcation. 

# See Figure 7.7. 

from matplotlib import pyplot as plt 


from matplotlib.animation import ArtistAnimation 
import numpy as np 
from scipy.integrate import odeint 


fig = plt.figure() 
myimages = [ ] 


def hopf(x, t): 
return [x[1] + mu x[O] - x[O] x[1] **2, mu * 
x[1] - x[0] 
- x[1] **3] 


time = np.arange(0, 200, 0.01) 

x0 = [1, 0] 

for mu in np.arange(-1, 1, 0.1): 
XS = odeint(hopf, x0, time) 
imgplot = plt.plot(xs[:, 0], xs[:, 1], "r-") 
myimages.extend([imgplot ] ) 


my_anim = ArtistAnimation(fig, myimages, interval = 
100, \ 
blit = False, repeat_delay = 100) 
plt.show() 


# Program 07c: Animation of a SNIC bifurcation. 
# See Figure 7.12. 

from matplotlib import pyplot as plt 

from matplotlib.animation import ArtistAnimation 
import numpy as np 

from scipy.integrate import odeint 


fig=plt.figure() 


def snic(x, t): 
return [x[O] (1 - x[0]*2 - x[1]**2) - x[1] * ( 
1 + mu + x[0]), 
x[1] (41 - x[0]*2 - x[1]**2) + x[O] * (1 + mu 
+ x[0])] 


time = np.arange(0, 200, 0.01) 


x0=|0.5,0] 

myimages=|[ ] 

for mu in np.arange(-3, 1, 0.1): 
xs = odeint(snic, x0, time) 
imgplot = plt.plot(xs[:, 0], xs[:, 1], ‘r-’) 
myimages.append(imgplot ) 


my_anim = ArtistAnimation(fig, myimages, interval = 
100, \ 
blit = False, repeat_delay = 100) 
plt.show() 


7.5 Exercises 


1. 
Consider the following one-parameter families of first order differential 


equations defined on R: 


a 7 
k= p—-x-—e%; 
(b) — 
t= xu + e”); 
(c) 
=x- A 


1+x2 


Determine the critical points and the bifurcation values, plot vector 
fields on the line, and draw a bifurcation diagram in each case. 
Use an animation program in Python to show how x varies as p 


increases from — 4 to + 4, for each of the differential equations in (a)-(c). 


Construct first order ordinary differential equations having the following: 
(a) ae 
three critical points (one stable and two unstable) when p < 0, one 
critical point when p = 0, and three critical points (one unstable and 
two stable) when p > 0; 
(b) 
two critical points (one stable and one unstable) for u ~ 0 and one 


critical point when p = 0; 


(c) 


one critical point if | u | = 1 and three critical points if | p | < 1. 


Draw a bifurcation diagram in each case. 
3. A certain species of fish in a large lake is harvested . The differential 
equation used to model the population, x(t) in hundreds of thousands, is 
given by 


dx X hx 
x(1 — z) - ; 
0.2+x 


Determine and classify the critical points and plot a bifurcation diagram. 
How can the model be interpreted in physical terms? 


4. 
Consider the following one-parameter systems of differential equations: 
(a) 
2m yopry: 
(b) 
ž=xX xu, ý= -y 
(c) 
k= -x + 5ux? — 4u, p=-y- 
Find the critical points, plot phase portraits, and sketch a bifurcation 
diagram in each case. 
5. 
Consider the following one-parameter systems of differential equations in 
polar form: 
(a) 
= ur(r+ u, @=13 
(b) 


t= ríu- r)u-— 2r), fsi 


c) =ru -r, O=1- 


10. 


Plot phase portraits for p < 0, p = 0, and p > 0 in each case. Sketch the 
corresponding bifurcation diagrams. 


Determine the nonlinear transformation which eliminates terms of degree 
three from the planar system 


= Ay x + a4x° + aax y + aj2xy? + ao3y°, 
he X 3 2 2 3 
y = Ay + bz3xX + bax y + bizxy" + boy”, 


where A 42 # 0. 


Show that the normal form of a nondegenerate Hopf singularity is given by 
ù 0 -p \fu au (u? - v?) —by (w - v?) 
„|= + 
v B O V av (u? + v?) + bu (u? + v?) 
+0 (jul?). 
where f > 0 anda = 0. 


Plot bifurcation diagrams for the planar systems 


(a) | 
f= r(u-0.2r +r- r°), 0 = -], 


(b) | 
p= r((r- a - pr), 0=1. 
Give a possible explanation as to why the type of bifurcation in part (b) 
should be known as a fold bifurcation . 
Show that the one-parameter system 
REFR o SE 


undergoes a Hopf bifurcation at u ọ = 0. Plot phase portraits and sketch a 
bifurcation diagram. 


Thus far, the analysis has been restricted to bifurcations involving only 


one-parameter, and these are known as codimension-1 bifurcations . This 
example illustrates what can happen when two parameters are varied, 
allowing the so-called codimension-2 bifurcations . 

The following two-parameter system of differential equations may be 
used to model a simple laser : 


x=xy-1), yroat+Py-x. 


Find and classify the critical points and sketch the phase portraits. 
Illustrate the different types of behavior in the (a, p) plane and determine 
whether or not any bifurcations occur. 
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8. Three-Dimensional Autonomous Systems 
and Chaos 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To introduce first-order ODEs in three variables. 
e To plot phase portraits and chaotic attractors. 
e To identify chaos. 


On completion of this chapter, the reader should be able to 


construct phase portraits for linear systems in three dimensions; 

use Python to plot phase portraits and time series for nonlinear systems; 
identify chaotic solutions; 

interpret the solutions to modeling problems taken from various scientific 
disciplines, and in particular, chemical kinetics, electric circuits, and 
meteorology. 


Three-dimensional autonomous systems of differential equations are 
considered. Critical points and stability are discussed and the concept of chaos is 
introduced. Examples include the Lorenz equations, used as a simple 
meteorological model and in the theory of lasers; Chua’s circuit, used in 
nonlinear electronics and radiophysics; and the Belousov-Zhabotinski reaction, 
used in chemistry and biophysics. All of these systems can display highly 
complex behavior that can be interpreted from phase portrait analysis or 
Poincaré maps (see Chapter 9). 

Basic concepts are explained by means of example rather than mathematical 
rigor. Strange or chaotic attractors are constructed using Python, and the reader 
is encouraged to investigate these systems through the exercises at the end of the 
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8.1 Linear Systems and Canonical Forms 


Consider linear three-dimensional autonomous systems of the form 


X = AX + 42y + 4132, 
ý = 21X + axy + 423Z, (8.1) 
Z = A3\X + 432% + 4332, 


where the a ;j are constants. The existence and uniqueness theorem (see 


Section 2.4) holds, which means that trajectories do not cross in three- 
dimensional space. The real canonical forms for 3 x 3 matrices are 


Ay 0 O Q —p 0 
Ji = 0 A2 0 ; J = p a O ; 
0 0 as 0 0 a; 
aA, 1 0 aA, 1 0 
J3=| 04 0|, J4=| 04 1 
00% 0 0 a, 


Matrix J , has three real eigenvalues; matrix J has a pair of complex 
eigenvalues; and matrices J and J 4 have repeated eigenvalues. The type of 
phase portrait is determined from each of these canonical forms. 


Definition 1. 
Suppose that Q €e 9? is a critical point of the system (8.1). Then the stable and 


unstable manifolds of the critical point 0 are defined by 
Es (0) = {x : A*(x) = 0}, Ey(0) = {x : A(x) = 0}. 


Example 1. 


Solve the following system of differential equations, sketch a phase portrait, and 
define the manifolds: 


X=Y y =y, Z= _Z. 


(8.2) 


Solution. There is one critical point at the origin. Each differential equation is 
integrable with solutions given by x(t)=C,e5 y(t) =C, et, and z(t) = C3 e ™. 
The eigenvalues and corresponding eigenvectors are À ; 5 = 1, (0, 1, 0)7, (1, 0, 0)? 
and A > = —1, (0, 0, 1)". System (8.2) may be uncoupled in any of the xy, xz, or yz 
planes. Planar analysis gives an unstable singular node in the xy plane and cols 


in each of the xz and yz planes. The phase plane portraits for two of the 
uncoupled systems are given in Figure 8.1. Ifz>0, z < 0, andifz<0, z>0. 


The z-axis is a one-dimensional stable manifold since trajectories on this line are 
attracted to the origin as t > +0. The xy plane is a two-dimensional unstable 
manifold since all trajectories in this plane are attracted to the origin as t > —oo. 


Yo 
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Figure 8.1 Phase plane portraits in the (a) xy and (b) xz planes. Note that (a) is an unstable planar 
manifold. 


Putting all of these together, any trajectories not lying on the manifolds flow 
along “lampshades” in three-dimensional space, as depicted in Figure 8.2. 


Example 2. 


Given the linear transformations x = x ; ~- 2y 4, yY = -Y 4, and zZ = -y į + Z 4, show 
that the system 


Xi = —3x; + 10y, yi = -2x + 5y, Zi = -2x +2yı + 3zı 
can be transformed into 
ž=x-2y, ý=2x+y, 238 (8.3) 


Make a sketch of some trajectories in xyz space. 


Figure 8.2 Phase portrait for system (8.2). The manifolds are not shown here. 


Solution. The origin is the only critical point. Consider the transformations. 
Then 


X = Ži — 2y] = (—3xı + 10y,) — 2(—2xı + 5y) = x] = x— 2y 
ý = -yı = —(-2xı + 5y1) = 2x, — 5y =2x +y 
Z = -y1 t% = —(-2x1 + 5y1) + (2x1 + 2y1 + 3z1) = 3(-y + z1) = 3z. 


System (8.3) is already in canonical form, and the eigenvalues are À 4 5 = 1 
i and A 3 = 3; hence the critical point is hyperbolic. The system can be 
uncoupled; the critical point at the origin in the xy plane is an unstable focus. A 


phase plane portrait is given in Figure 8.3. 


i 
ee 
Oe 
LL 6 ooo 
LEE GPE 

Pi fee: 
LLLE el or 


ERRAR oh ak ot oe 

a 7 7 7 7 7D 
er TY Ze 
— OZ 
er OT OT 
TS Or 
Se So 
Sa 


ere oe 


\NR 7777 7/7 7 
WQS 7 77 7 7 
N wee 7 7 7 / 
\ we 7 7 / 
Ny I~ ws Se 77 7 
\AWWWROS SS PO 


NA a O  Oeer 
Figure 8.3 Some trajectories in the xy plane. 


Note that all trajectories spiral away from the origin, as depicted in 
Figure 8.4. Since all trajectories tend to the origin as t > —oo, the whole phase 
space forms an unstable manifold. 


Figure 8.4 Phase portrait for system (8.3). 


Example 3. 
Use Laplace transforms to solve the following initial value problem 


X=72-xX, y=-y, z2z=z—17x+ 16, (8.4) 


with x(0) = y(0) = z(0) = 0. 8, and plot the solution curve in three-dimensional 
space. 


Solution. System (8.4) can be uncoupled. The differential equation y = —y has 


general solution y(t) = y ọ e ‘, and substituting y ọ = 0. 8 gives y(t) = 0. 8e ~. 
Now z = x+ x, and therefore the equation z = z — 17x + 16 becomes 


(X+ Xx) = (X+ x) - 17x + 16, 
which simplifies to 
K+ 16x = 16. 
Take Laplace transforms of both sides and insert the initial conditions to obtain 
55) <b - 028 
os st + 16 


Take inverse transfarmes tn det 


iio Wiech, pias eee ea eek 
x(t) = 1 — 0.2 cos(4t), 
and therefore 
z(t) = 1 + 0.8 sin(4f) — 0.2 cos(4t). 


The solution curve is plotted in Figure 8.5. 


1 


0 
0 0.1 
0.2 0.3 0.4 0.50607 5 xÒ 


vA 


Figure 8.5 The solution curve for the initial value problem in Example 3. The trajectory ends up on an 
ellipse in the y = 0 plane. 


8.2 Nonlinear Systems and Stability 


If the critical point of a three-dimensional autonomous system is hyperbolic, 
then the linearization methods of Hartman can be applied. If the critical point is 
not hyperbolic, then other methods need to be used. 


Definition 2. 
Suppose that p € XR? is a critical point of the nonlinear system x = f(x), where 


x € R3. Then the stable and unstable manifolds of the critical point p are 


defined by 
Ws(p) = {x : A*(x) =p}, Wup) = tx: A (x) = ph. 


As for two-dimensional systems, three-dimensional systems can have stable and 
unstable manifolds. These manifolds can be convoluted surfaces in three- 
dimensional space. A survey of methods used for computing some manifolds is 
presented in [12]. 


Theorem 1. 
Consider the differential equation 


x-f(x) xeR”, 
where f € C (E) and E is an open subset of R” containing the origin. Suppose 


that £(0) = 0 and that the Jacobian matrix has n eigenvalues with nonzero real 
part. Then, in a small neighborhood of x = 0 , there exist stable and unstable 
manifolds W and W y with the same dimensions n s and n y as the stable and 


unstable manifolds (E < , E y ) of the linearized system 
Xx = JX, 


where W < and W yare tangent to E and E yatx=0. 


A proof to this theorem can be found in Hartman’s book, see Chapter 3 


Definition 3. The center eigenspace, say, E ç, is defined by the eigenvectors 


corresponding to the eigenvalues with zero real part, and the center manifold, 
say, W ç, is the invariant subspace which is tangent to the center eigenspace E ç. 


In general, the center manifold is not unique. 


Theorem 2 (The Center Manifold Theorem). Letf E€ C'(E), (r= 1), where 
E is an open subset of R” containing the origin. If £(0) = 0 and the Jacobian 


matrix has n s eigenvalues with negative real part, n ,, eigenvalues with positive 
real part, and n ¢=n-Nngs-ny purely imaginary eigenvalues, then there exists 


an n ç -dimensional center manifold W ç of class C" which is tangent to the 
center manifold E ¢ of the linearized system. 


To find out more about center manifolds, see Wiggins [20]. 


Example 4. 
Determine the stable, unstable, and center manifolds of the nonlinear system 


: 2) . x 
Lx, yor, Z= -—2z. 


Solution. There is a unique critical point at the origin. This system is easily 
solved, and it is not difficult to plot phase portraits for each of the uncoupled 


systems. The solutions are x(t) = — 7 y(t) = C, e ™*, and z(t)=C3e *4 The 
= 


eigenvalues and corresponding eigenvectors of the Jacobian matrix are A , = 0, 
(1, 0,0)", à » = —1, (0, 1, 0)", and A 3 = —2, (0, 0, 1)". In this case, W C= E ç, the 
x-axis, and the yz plane forms a two-dimensional stable manifold, where W s = E 
s- Note that the center manifold is unique in this case, but it is not in general. 


Example 5. 
Solve the following nonlinear differential system 


. . : 2 
k=-x, j=-y+x, 2-742, 


and determine the stable and unstable manifolds. 


Solution. The point O = (0, 0, 0) is a unique critical point. Linearize by finding 
the Jacobian matrix . Hence 


Ox Oy Oz 
j= dQ dQ AQ 
— | Ox dy dz |? 
OR OR OR 
Ox Oy Oz 


where x = P(x, y,z),¥ = O(x,y, Zz), and z = R(x, y, z). Therefore, 


-1 0 0 
Jo=| 0 -1 0j, 
0 0 | 


and the origin is an unstable critical point. Note that two of the eigenvalues are 
negative. These give a two-dimensional stable manifold, which will now be 


detined. 
The differential equation y = —.x is integrable and has solution x(t) = C , e “. 


The other two differential equations are linear and have solutions y(t) = C5 e ‘+ 


Cie t-e~*4) and WiC es Sees _ ey Now A +(x) = 0 if and only if 


C , where x € R3, C 1 =x(0), C = y(0), and C 3 = z(0). Therefore, 
C3 + a = 0 


the stable manifold is given by 


2 
Ws = fxe: z= -Fh 


Using similar arguments, A (x) = 0 if and only if C į = C , = 0. Hence the 
unstable manifold is given by 


Wy ={xER?:x=y=0}. 


Note that the surface W ș is tangent to the xy plane at the origin. 


Definition 4. An attractor is a minimal closed invariant set that attracts 
nearby trajectories lying in the domain of stability (or basin of attraction ) onto 
it. 


Example 6. 
Sketch a phase portrait for the system 


kaxty—-x0'+y’), po-xty-yo't+y’), z= -2z. (8.5) 


Solution. Convert to cylindrical polar coordinates by setting x = rcos@ and y = 
rsin@. System (8.5) then becomes 


r= -rh l=- F=—zZ 


The origin is the only critical point. The system uncouples; in the xy plane, 
the flow is clockwise and the origin is an unstable focus. If z > 0, then z < 0, 


and if z < 0, then z > 0. If r= 1, then 7+ = 0. Trajectories spiral towards the xy 


plane and onto the limit cycle, say, I’ ,, of radius 1 centered at the origin. Hence 


A*(x) =I ,ifx #0 andT, isa stable limit cycle. A phase portrait is shown in 
Figure 8.6. 


Figure 8.6 ‘Trajectories are attracted to a stable limit cycle (an attractor) in the xy plane. 


Lyapunov functions were introduced in Chapter 6 and were used to 
determine the stability of critical points for certain planar systems. The theory is 
easily extended to the three-dimensional case as the following examples 
demonstrate. Once again, there is no systematic way to determine the Lyapunov 
functions, and they are given in the question. 


Example 7. 
Prove that the origin of the system 


ž= -2y +yz ý=x(l-z) ż=xy 


is stable but not asymptotically stable by using the Lyapunov function V (x, y, z) 


=ax*+ by? + cz?. 


Solution. Now 


dV O0Vdx 7 OV dy P OV dz 
dt Oxdt dydt dzdt 
If b = 2a anda = c > 0, then V (x, y, z) > 0 for all x 0 and L — (). Thus the 


=2(4— b + c)xyz + (b = 2a)xy. 


trajectories lie on the ellipsoids defined by x * + 2y ? + z ° = r ?. The origin is 
thus stable but not asymptotically stable. 


Example 8. 
Prove that the origin of the system 
s=- Sr =a, Jaar =y, eana =e 


is asymptotically stable by using the Lyapunov function V (x, y,z) =x? +y? +z 
2 


Solution. Now 
dV ðVdx , OV dy P OV dz 
dt Oxdt dydt ðzdt 


Since a < Q for x, y, z # 0, the origin is asymptotically stable. In fact, the origin 
d 


= -2(x¢ + yt +372 4+ xy 4g), 


is globally asymptotically stable since A *(x) = (0, 0, 0) for all x € 93. 


8.3 The Rossler System and Chaos 


8.3.1 The Rossler Attractor 


In 1976, Otto E. Réssler [16] constructed the following three-dimensional 
system of differential equations: 


ž=-(y +z) ý=x+ay, Z=b+xz- cz, 


(8.6) 
where a, b, and c are all constants. Note that the only nonlinear term appears 
in the z equation and is quadratic. As the parameters vary, this simple system 


can display a wide range of behavior. Set a = b = 0. 2, for example, and vary the 
parameter c. The dynamics of the system can be investigated using Python. Four 
examples are considered here. Transitional trajectories have been omitted to 


avoid confusion. The initial conditions are x(0) = y(0) = z(0) = 1 in all cases. 


Definition 5. A limit cycle in three-dimensional space is called a period-n 
cycle if x(t) = x(t + nT) for some minimum constant T. Note that n can be 
determined by the number of distinct amplitudes in a time series plot. 


When c = 2. 3, there is a period-one limit cycle which can be plotted in three- 
dimensional space. Figure 8.7(a) shows the limit cycle in phase space, and the 
periodic behavior with respect to x(t) is shown in Figure 8.7(b). 
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Figure 8.7 (a) A limit cycle for system (8.6) when c = 2. 3. (b) Period-one behavior for x(t). 


When c = 3. 3, there is period-two behavior. Figure 8.8(a) shows the closed 
orbit in phase space, and the periodic behavior is shown in Figure 8.8(b). Notice 
that there are two distinct amplitudes in Figure 8.8(b). This periodic behavior 
can be easily detected using Poincaré maps (see Chapter 9). 
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Figure 8.8 (a) A period two limit cycle for system (8.6) when c = 3. 3. (b) Period-two behavior for x(t). 


When c = 5. 3, there is period-three behavior. Figure 8.9(a) shows the closed 
orbit in three-dimensional space, and the periodic behavior is shown in 
Figure 8.9(b). Note that there are three distinct amplitudes in Figure 8.9(b). 

When c = 6. 3, the system displays what appears to be random behavior . 
This type of behavior has been labeled deterministic chaos . A system is called 
deterministic if the behavior of the system is determined from the time evolution 
equations and the initial conditions alone, as in the case of the Réssler system. 
Nondeterministic chaos arises when there are no underlying equations, as in the 
United Kingdom national lottery, or there is noisy or random input. This text 
will be concerned with deterministic chaos only, and it will be referred to simply 
as chaos from now on. 


8.3.2 Chaos 
Chaos is a multifaceted phenomenon that is not easily classified or identified. 
There is no universally accepted definition for chaos, but the following 
characteristics are nearly always displayed by the solutions of chaotic systems: 
1. 

long-term aperiodic (nonperiodic ) behavior; 
2. 


sensitivity to initial conditions ; 


3. 
fractal structure (see Chapter 17). 


Consider each of these items independently. Note, however, that a chaotic 
system generally displays all three types of behavior listed above. 

Case 1. It is very difficult to distinguish between aperiodic behavior and 
periodic behavior with a very long period. For example, it is possible for a 
chaotic system to have a periodic solution of period 101%, 

Case 2. A simple method used to test whether or not a system is chaotic is to 
check for sensitivity to initial conditions. Figure 8.10(a) shows the trajectory in 
phase space and Figure 8.10(b) illustrates how the system is sensitive to the 
choice of initial conditions. 


Definition 6. A strange attractor , (chaotic attractor , fractal attractor ) is an 
attractor that exhibits sensitivity to initial conditions. 
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Figure 8.9 (a) A period three limit cycle for system (8.6) when c = 5. 3; (b) period three behavior for x(t). 


Definition 7. The spectrum of Lyapunov exponents are quantities that 
characterize the rate of separation of infinitesimally close trajectories. They are 


used to determine where dynamical systems are periodic, undergo bifurcation, or 
are chaotic. 
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Figure 8.10 [Python] (a) The chaotic attractor for system (8.6) when c = 6. 3. In this case, iteration was 
used to solve the ODEs. (b) Time series plot of x(t) showing sensitivity to initial conditions; the initial 
conditions for one time series are x(0) = y(0) = z(0) = 1 and for the other are x(0) = 1. 01, y(0) = z(0) = 1. 
Use different colors when plotting in Python. 


An example of a strange attractor is shown in Figure 8.10(a). Another 
method for establishing whether or not a system is chaotic is to use the Lyapunov 
exponents (see Chapter 14 for examples in the discrete case). A system is chaotic 
if at least one of the Lyapunov exponents is positive. This implies that two 
trajectories that start close to each other on the strange attractor will diverge as 
time increases, as depicted in Figure 8.10(b). Note that an n-dimensional system 
will have n different Lyapunov exponents. Think of an infinitesimal sphere of 
perturbed initial conditions for a three-dimensional system. As time increases the 
sphere will evolve into an infinitesimal ellipsoid. If d 9 is the initial radius of the 


sphere, then d= dye*i'(j = 1,2, 3) define the axes of the ellipsoid. The 


following results are well known for three-dimensional systems. For chaotic 
attractors A ; > 0, À 5 = 0, and A 3 < 0; for single critical points A į < 0, à> <0, 
and A 3 < 0; for limit cycles A , = 0, À 5 < 0, and À 3 < 0; and for a 2-torus A 4 = 0, 
A» = 0, and A 3 < 0. A comparison of different methods for computing the 
Lyapunov exponents is given in [9]. One interesting feature of strange attractors 


is that it is sometimes possible to reconstruct the attractor from time series data 
alone, see [23], for example. Many papers have also been published on the 
detection of chaos from time series data [6, 7, 10, 15], and [21], where the 
underlying equations may not be required. 

Gottwald and Melbourne [10] describe a new test for deterministic chaos. 
Their diagnostic is the real valued function 


pa) = | B costes) 
0 


where @ is an observable on the dynamics x(t) and œ , # 0 is a constant. They set 
K = lim log DAD Ho 
ise log(t) 
where M is the mean-square displacement for p(t). Typically, K = 0 signifying 
regular dynamics, or K = 1 indicating chaotic dynamics . They state that the test 
works well for both continuous and discrete systems. 

Case 3. The solution curves to chaotic systems generally display fractal 
structure (see Chapter 17). The structure of the strange attractors for general n- 
dimensional systems may be complicated and difficult to observe clearly. To 
overcome these problems, Poincaré maps , which exist in lower-dimensional 
spaces, can be used, as in Chapter 9. 

Case 4. Power spectra of time series data can be used to determine whether a 
system is periodic, quasiperiodic, or chaotic (see Chapter 18). 


8.4 The Lorenz Equations, Chua’s Circuit, and the 


Belousov-Zhabotinski Reaction 


Note that, in the natural world, most nonlinear systems display periodic behavior 
most of the time. Fortunately, it is sometimes possible to predict, for example, 
the weather, the motion of the planets, the spread of an epidemic, or the beat of 
the human heart. However, nonlinear systems can also display chaotic or 
stochastic behavior where prediction becomes impossible. 

There are many examples of applications of three-dimensional autonomous 
systems to the real world. These systems obey the existence and uniqueness 
theorem, but the dynamics can be much more complicated than in the two- 
dimensional case. The following examples taken from meteorology , electric 
circuit theory, and chemical kinetics have been widely investigated in recent 
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Note that the Lorenz attractor appeared before the Réssler attractor, but the 
dynamics of the latter attractor are simpler, that is why the Rossler attractor 
appeared in the previous section. 


8.4.1 The Lorenz Equations 

In 1963, the MIT meteorologist Edward Lorenz [13] constructed a highly 
simplified model of a convecting fluid. This simple model also displays a wide 
variety of behavior and for some parameter values is chaotic. The equations can 
be used to model convective flow up through the center and down on the sides of 
hexagonal columns (due to convection). The system is given by 


xX=o(y-x) Yy=rx-y-—xz, Z=xy—- bz, 


(8.7) 

where x measures the rate of convective overturning, y measures the horizontal 
temperature variation, z measures the vertical temperature variation, o is the 
Prandtl number , r is the Rayleigh number , and b is a scaling factor. The Prandtl 
number is related to the fluid viscosity , and the Rayleigh number is related to 
the temperature difference between the top and bottom of the column. Lorenz 
studied the system when o = 10 and p = š, 


The system can be considered to be a highly simplified model for the weather. 
Indeed, satellite photographs from space show hexagonal patterns on 
undisturbed desert floors - this is as a result of convection of air currents. The 
astonishing conclusion derived by Lorenz is now widely labeled as the butterfly 
effect . Even this very simple model of the weather can display chaotic 
phenomena. Since the system is sensitive to initial conditions, small changes to 
wind speed (convective overturning), for example, generated by the flap of a 
butterfly’s wings, can change the outcome of the results considerably. For 
example, a butterfly flapping its wings in Britain could cause or prevent a 
hurricane from occurring in the Bahamas in the not-so-distant future. Of course, 
there are many more variables that should be considered when trying to model 
weather systems, and this simplified model illustrates some of the problems 
meteorologists have to deal with. 

Some simple properties of the Lorenz equations will now be listed, and all of 
these characteristics can be investigated with the aid of Python: 


1. 
System (8.7) has natural symmetry (x, y, zZ) > (7x, -y, Z). 


2, 


The z-axis is invariant. 


The flow is volume contracting since divX = -(ø + b + 1) < 0, where X is 
the vector field. 


If 0 <r <1, the origin is the only critical point, and it is a global attractor. 


Atr = 1, there is a bifurcation, and there are two more critical points at 


Ci =( vbr - 1), Vb(r - 1),7r - 1) and 
Cy, =(— yb@ — 1), = yb — 1), r= 1): 


Atr =r ,,* 13.93, there is a homoclinic bifurcation (see Chapter 7) and the 
system enters a state of transient chaos. 


Atr ~ 24. 06, a strange attractor is formed. 


If 1<r<ro, where r 9 * 24. 74, the origin is unstable and C ; and C , are 
both stable. 


Atr >r o, C, and C ù, lose their stability by absorbing an unstable limit 
cycle in a subcritical Hopf bifurcation . 
For more details, see the work of Sparrow [19] or most textbooks on nonlinear 


dynamics. Most of the results above can be observed by plotting phase portraits 
or time series using Python. A strange attractor is shown in Figure 8.11. 


Lorenz Attractor 


Figure 8.11 [Python] A strange attractor for the Lorenz system when ¢ = {(. } = 8 , and r = 28. In this 


case, the odeint numerical solver was used to solve the ODEs. 


The trajectories wind around the two critical points C ; and C , in an 


apparently random unpredictable manner. The strange attractor has the following 
properties: 


The trajectory is aperiodic (or not periodic). 

The trajectory remains on the attractor forever (the attractor is invariant ). 
The general form is independent of initial conditions. 

The sequence of windings is sensitive to initial conditions. 

The attractor has fractal structure . 


A variation on the Lorenz model has recently been discovered by Guanrong 
Chen and Tetsushi Ueta (see Figure 8.12). The equations are 


x=o(-x), ý=(r-0o)x+ry-—xz, Z=xy-— bz. 


(8.8) 


Figure 8.12 A strange attractor for system (8.8) when o = 35, b = 3, and r = 28. 


8.4.2 Chua’s Circuit 


Elementary electric circuit theory was introduced in Chapter 2 In the mid-1980s 
Chua modeled a circuit that was a simple oscillator exhibiting a variety of 
bifurcation and chaotic phenomena. The circuit diagram is given in Figure 8.13. 
The circuit equations are given by 


Oi, OVS I) ae OU a) et a 
dt 7 Ci ? dt = G a T’ 


Figure 8.13 Chua’s electric circuit. 


where v 4, V 5, and i are the voltages across C 4, C 5, and the current through L, 
respectively. The characteristic of the nonlinear resistor N p is given by 


f~i) = Gp + 0.5(Ga = Gp) (vı + B,| = [vı = B,|) > 


where G = VR. Typical parameters used are C , = 10. 1 nF, C = 101 nF, L = 20. 
8 mH, R = 1420 Q, r = 63. 8 Q, G , = —0. 865 mS, G , = -0. 519 mS, and B „= 1. 
85 V. 


In the simple case, Chua’s equations can be written in the following 
dimensionless form: 


X=aly—x-g(x)), ý=x-y+z, ż= —by, (8.9) 


where a and b are dimensionless parameters. The function g(x) has the form 
1 
8(x) = cx + 5 —c)(x+ 1[-|x- 1), 


where c and d are constants. 

Chua’s circuit is investigated in some detail in [14] and exhibits many interesting 
phenomena including period-doubling cascades to chaos, intermittency routes to 
chaos, and quasiperiodic routes to chaos. For certain parameter values, the 
solutions lie on a double-scroll attractor , as shown in Figure 8.14. 


Figure 8.14 [Python animation] Chua’s double-scroll attractor: Phase portrait for system (8.9) when a = 
15, b = 25. 58, c = -57, and d = —-8/. The initial conditions are x(0) = —1. 6, y(0) = 0, and z(0) = 1. 6. 


The dynamics are more complicated than those appearing in either the 
Rossler or Lorenz attractors. Chua’s circuit has proved to be a very suitable 
subject for study since laboratory experiments produce results which match very 
well with the results of the mathematical model. In 2002, the author and 


Borresen [2] showed the existence of a bistable cycle for Chua’s electric circuit 
for the first time. Power spectra for Chua’s circuit simulations are used to show 
how the qualitative nature of the solutions depends on the history of the system. 
A Python program showing an animation of a Chua circuit bifurcation is listed in 
Program 8d in Section 8.5. 

Zhou et al. [22] report on a new chaotic circuit that consists of only a few 
capacitors, operational amplifiers, and resistors and [5] provides a concise guide 
to chaotic electronic circuits up to 2014. 


8.4.3 The Belousov-Zhabotinski (BZ) Reaction 
Oscillating chemical reactions such as the Bray-Liebhafsky reaction [3], the 
Briggs-Rauscher reaction [4], and the BZ reaction provide wonderful examples 
of relaxation oscillations in science (see [1, 8, 18]). They are often demonstrated 
in chemistry classes or used to astound the public at university open days. The 
first experiment of the BZ reaction was conducted by the Russian biochemist 
Boris Belousov in the 1950s, and the results were not confirmed until as late as 
1968 by Zhabotinski. 
Consider the following recipe for a BZ oscillating chemical reaction. 
Ingredients. 


e Solution A: Malonic acid, 15.6 gm/l. 

e Solution B: Potassium bromate, 41.75 gm/l, and potassium bromide, 0.006 
gm/l. 

e Solution C: Cerium IV sulfate, 3.23 gm/l in 6M sulfuric acid. 

e Solution D: Ferroin indicator. 


Procedure. Add 20 ml of solution A and 10 ml of solution B to a mixture of 
10 ml of solution C and 1 ml of solution D. Stir continuously at room 
temperature. The mixture remains blue for about 10 minutes and then begins to 
oscillate blue-green-pink and back again with a period of approximately two 
minutes. 

This reaction is often demonstrated by Chemistry Departments during 
university open days and is always a popular attraction. 

Following the methods of Field and Noyes (see [8]) the chemical rate 
equations for an oscillating Belousov-Zhabotinski reaction are frequently written 
as 


BrO} + Br — HBrO, + HOBr, Rate = see |[Br-] 
HBrO> + Br — 2HOBr, Rate = k»[HBrO>|[Br-] 
BrO; + HBrO, > 2HBrO; + 2Mox, Rate = k3[BrO, |[HBrO>] 
2HBrO, — BrO, + HOBr, Rate = KANBOsh 

OS + Mox > +CBr , Rate = ks[OS][Mox] 


where OS represents all oxidizable organic species and C is a constant. Note that 
in the third equation, species HBrO, stimulates its own production, a process 


called autocatalysis . The reaction rate equations for the concentrations of 
intermediate species x = [HBrO,], y = [Br ], and z = [Mo x] are 


x = kay- koxy + k3ax — Iar. 
ý = —kyay — kyxy + 3Cksbz, 
Zz = 2k3ax — ksbz, 


(8.10) 
where a = [BrO3  ] and b = [OS] are assumed to be constant, and [Mox] 
represents the metal ion catalyst in its oxidized form. Taking the transformations 


2k4x ky ksk4bz 
X= , Y = —, Z= oe T = ksbt, 
ksa k3a (k3a) 
system (8.10) becomes 
dX _ gv-X¥+X(1-X) 
an Y-xXY+CZ l 
dY — Zq -XY+CZ 
dr & ? (8.11) 
dZ _ BN 
dr X-Z, 
where - — 5b, . — 2kskab, and 2kık4, Next, one assumes that €, << 1 so 
& =F 2 = q = 
k3a = ‘Tokaa Koka 


that = is large unless the numerator — qY — XY + CZ is also small. Assume that 
aT 


CZ 
q+ X 


Y = Y* = 


at all times, so the bromide concentration Y = [Br ] is in a steady state compared 
to X. In this way, a three-dimensional system of differential equations is reduced 


to a two-dimensional system of autonomous ODEs 


ea% = X(1 - X) - %4CZ, aZ- X-Z. 


lar dt 


(8.12) 
For certain parameter values, system (8.12) has a limit cycle that represents an 
oscillating Belousov-Zhabotinski chemical reaction, as in Figure 8.15. 
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Figure 8.15 A limit cycle in the XZ plane for system (8.12) when € 4 = 0.05, q = 0.01, and C = 1. 


Example 9. Find and classify the critical points of system (8.12) when € 4 = 0. 
05, q = 0.01, and C = 1. Plot a phase portrait in the first quadrant. 


Solution. There are two critical points, one at the origin and the other at A ~ (0. 
1365, 0. 1365). The Jacobian matrix is given by 


1 (1-2x - z% + 2a) 1 (£4) 


J=\«a X+q (X+?) a \X+q 


l -] 


It is not difficult to show that the origin is a saddle point and A is an unstable 


node. A phase portrait showing periodic oscillations is given in Figure 8.15. 

The period of the limit cycle in Figure 8.15 is approximately 3. 4. The 
trajectory moves quickly along the right and left branches of the limit cycle (up 
and down) and moves relatively slowly in the horizontal direction. This accounts 
for the rapid color changes and time spans between these changes. 

It is important to note that chemical reactions are distinct from many other 
types of dynamical system in that closed chemical reactions cannot oscillate 
about their chemical equilibrium state. The concentrations of some reactants of 
the mixture pass repeatedly through the same value; however, the energy- 
releasing reaction that drives the oscillations moves continuously toward 
completion, which means that the oscillations will eventually stop. 

It is also possible for the BZ reaction to display chaotic phenomena; see [1], 
for example. Multistable and bistable chemical reactions are also discussed in 
[18]. In these cases, there is an inflow and outflow of certain species and more 
than one steady state can coexist. 

Finally, consider the dimensionless system (8.11) when € , = 0. 0099, € 5 = 


2. 4802e-5, q = 3. 1746e-5, and C = 1. This is a stiff system of ODEs and is 
intractable to analytical approaches, instead we solve the system numerically. 
The relative concentrations of bromous acid, bromide ions, and cerium ions are 
shown in Figure 8.16. 


Relative concentration of bromous acid 


0 10 20 30 40 50 


Relative concentration of bromide ions 


4000 

z ae, ae | | ek AA 
0 10 20 30 40 50 

t 

ja Relative concentration of cerium ions 

0.2 

a ee | | or LS 

10 20 30 40 50 


0 


z(t) 


t 


Figure 8.16 [Python] Periodic behavior for the stiff ODE (8.11) when X(0) = 0, Y (0) = 0, Z(0) = 0. 1,e 4 = 
0. 0099, € 2 = 2. 4802e-5, q = 3. 1746e-5, and C = 1. Note that the direct physical significance is lost and the 


graph shows relative concentrations of each of the concentrations of ions. 


8.5 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


Python Commands Comments 

Axes3D # Object created using projection =’ 3d’. 

mplot3d # Toolkit adds simple 3D plotting 
capabilities. 


# Program 08a: The Rossler chaotic attractor. See F 
ig. 8.10(a). 
# In this case, iteration is used to solve the ODEs 


import numpy as np 
import matplotlib.pyplot as plt 
from mpl_toolkits.mplot3d import Axes3D 


def Rossler(x, y, Zz, a= 0.2, b=0.2, c=6.3): 


x dot =-y- zZ 
y_dot =x+t+a* y 
z dot =b+x*z-c*zZ 


return x_dot, y_dot, z_dot 


dt = 0.01 
step_count = 50000 


xs=np.empty((step_count + 1,)) 
ys=np.empty((step_count + 1,)) 
zs=np.empty((step_count + 1,)) 


I 


# The initial conditions. 
xs[O], ys[O], zs[O] = (1.0, 1.0, 1.0) 


# Iterate. 
for 1 in range(step_count): 


x_dot, y_dot, z_dot = Rossler(xs[i], ys[i], zs[ 


ij) 
xs[iti] = xs[i] + (x_dot*dt) 
ys[i+1] = ys[i] + (y_dot*dt) 
zs[i+1] = zs[i] + (z_dot*dt) 


fig=plt.figure() 
ax=Axes3D(f1ig) 


ax.plot(xs, ys, zs, lw=0.5) 

ax.set_xlabel(’x’, fontsize=15) 
ax.set_ylabel(’y’, fontsize=15) 
ax.set_zlabel(’z’, fontsize=15) 
plt.tick_params(labelsize=15) 
ax.set_title(’Rossler Attractor’, fontsize=15) 
plt.show() 


# Program O8b: The Lorenz attractor. See Figure 8.1 
oe 

# In this case, the odeint numerical solver was use 
d to solve the ODE. 


import numpy as np 

from scipy.integrate import odeint 
import matplotlib.pyplot as plt 

from mpl_toolkits.mplot3d import Axes3D 


# Lorenz parameters and initial conditions 
Sigma, beta, rho = 10, 2.667, 28 
x0, yO, z0 = O, 1, 1.05 


# Maximum time point and total number of time point 


tmax, n = 100, 10000 


def Lorenz(X, t, Sigma, beta, rho): 
"""The Lorenz equations.""" 
X, y, Z =X 
dx = -sigma * (x - y) 
dy = rho *x-y-+-x* Z 


dz = -beta * z+x* y 
return dx, dy, dz 


# Integrate the Lorenz equations on the time grid t 


t np.linspace(0, tmax, n) 

f odeint(Lorenz, (x0, yO, z0), t, args= 
(sigma, beta, rho)) 

xX, y, 2 = f.T 


# Plot the Lorenz attractor using a Matplotlib 3D p 
rojection. 

fig=plt.figure() 

ax = Axes3D(fig) 

ax.plot(x, y, z, ‘b-’, lw=0.5) 

ax.set_xlabel(’x’, fontsize=15) 

ax.set_ylabel(’y’, fontsize=15) 

ax.set_zlabel(’z’, fontsize=15) 

plt.tick_params(labelsize=15) 

ax.set_title(’Lorenz Attractor’, fontsize=15) 

plt.show() 


# Program 08c: The Belousov- 
Zhabotinski Reaction. See Figure 8.16. 
# Plotting time series for a 3-dimensional ODE. 


import numpy as np 
from scipy.integrate import odeint 
import matplotlib.pyplot as plt 


# B_Z parameters and initial conditions. 

q, f, eps, delta = 3.1746e-5, 1, 0.0099, 2.4802e-5 
x0, yO, z0 = ©, ©, 0.1 

# Maximum time point and total number of time point 


tmax, n = 50, 10000 


def bz_reaction(X,t,q,f,eps,delta): 
X, y, Z =X 
dx =(q*y-xX y+x (1 - X))/eps 
(-q y -x y+ f * z)/delta 
dz =x -Z 
return dx, dy, dz 


[oS 
< 
I l 


t np.linspace(0, tmax, n) 

f odeint(bz_reaction, (x0, yO, z0), t, args= 
((q, f, eps, delta))) 

x, y, Z = f.T 


# Plot time series. 

fig = plt.figure(figsize=(15,5)) 

fig.subplots_adjust(wspace = 0.5, hspace = 0.3) 

ax1 = fig.add_subplot(1, 3, 1) 

axi.set_title(’Relative concentration bromous acid’ 
, tontsize=12) 

ax2 = fig.add_subplot(1, 3,2) 

ax2.set_title(’Relative concentration bromide ions’ 
, ftontsize=12) 

ax3 = fig.add_subplot(1,3,3) 

ax3.set_title(’Relative concentration cerium ions’, 
fontsize=12) 


axi.plot(t, x, ‘b-’) 
ax2.plot(t, y, ‘r-’) 
ax3.plot(t, z, ‘m-’) 
plt.show() 


# Programs 08d: Animation of a Chua circuit bifurca 
tion. 

# You can watch a YouTube animation on the web. 

# Search for Chua circuit AND oscilloscope. 


from matplotlib import pyplot as plt 
from matplotlib.animation import ArtistAnimation 


import numpy as np 
from scipy.integrate import odeint 


fig=plt.figure() 


mo = -1/7 
mi = 2/7 
tmax = 100; 


def chua(x, t): 
return [a * (x[1] - (m1 x[0] + (mo - m1) / 2 
(np.abs(x[O] + 1) - \ 
np.abs(x[O] - 1)))), x[O] - x[1] + x[2], -15 * 
x[1]] 


time = np.arange(0, tmax, 0.1) 

x0=[1.96, -0.0519, -3.077] 

myimages = [] 

for a in np.arange(8, 11, 0.1): 
xs = odeint(chua, x0, time) 
imgplot = plt.plot(xs[:, 0], xs[:, 1], "r-") 
myimages.append(imgplot ) 


my_anim=ArtistAnimation(fig, myimages, interval=500 
PAN 
blit=False, repea 
t_delay=500) 
plt.show() 


8.6 Exercises 


"Find the eigenvalues and eigenvectors of the matrix 
1 0 -4 

A=] 054 

—4 3 


Hence show that the system x = Ax can be transformed into ù = Ju, 
where 


3 0 
J=|0 - 
0 0 


Oo 


0 
0 
9 
Sketch a phase portrait for the system ù = Ju. 


Classify the critical point at the origin for the system 


K=x+2z, yey-3z, 2=2y+z. 


`- Find and classify the critical points of the system 


t= X=, ypoyty’, Z=X-Z. 


~ Consider the system 
X= —-x+(A-xX)y, yox-U-ay-yt2z, z2=5-z 


where A > 0 is a constant. Show that the first quadrant is positively invariant 
and that the plane x + y + 2z = constant is invariant. Find A *(p) for p in the 
first quadrant given that there are no periodic orbits there. 
(a 

Prove that the origin of the system 


. 3 


tery iar. y=-ytetx-y, z=-ztx't+yz-2 


is globally asymptotically stable . 
(b) 


Determine the domain of stability for the system 


X= -ax+xyz, ý = —by + Xyz, Ż = —CZ + xyz. 


. The chemical rate equations for the Chapman cycle modeling the production 
of ozone are 


O,+ hv => O +O, Rate = kı, 
O2 +0+M > O; +M, Rate = ko, 
O; + hv > O; + O, Rate = k3, 
O + 03 => O2 + O», Rate = ka, 


where O is a singlet , O, is oxygen, and O; is ozone. The reaction rate 
equations for species x = [O], y = [O5], and z = [O3] are 


x = 2kyy + kzz — koxy[M] - k4xz, 
y = kzz + 2kąxz — kıy — koxy[M], 
Z = kyxy[M] — k3z — k4xz. 


This is a stiff system of differential equations. Many differential equations 
applied in chemical kinetics are stiff. Given that [M] = 9e17, k į = 3e-12,k , 


= 1. 22e-33, k 3 = 5. 5e-4, k 4 = 6. 86e-16, x(0) = 4e16, y(0) = 2e16, and 
z(0) = 2e16, show that the steady state reached is [O] = 4. 6806e7, [O,] = 6. 
999e16, and [O3] = 6. 5396e12. 


~ A three-dimensional Lotka-Volterra model is given by 
x=x01-2x+y-5z), y=y1—-5x-2y-z), ż=z(l +x- 3y- 2z). 


Prove that there is a critical point in the first quadrant at P(Ł, 3 


oe Ti Plot 
14° 14 


possible trajectories and show that there is a solution plane y+ y+ z = L. 


Interpret the results in terms of species behavior. 

. Assume that a given population consists of susceptibles (S), exposed (E), 
infectives (I), and recovered/immune (R) individuals. Suppose that S + E + I 
+ R= 1 for all time. A seasonally driven epidemic model is given by 


S=p1-S)-BSI, E=BSI-(Qut+@ME, T=aeE-(u+y)l, 
where = contact rate , ~~! = mean latency period , y ™t = mean infectivity 


period , and u ~} = mean lifespan. The seasonality is introduced by assuming 
that $ = B(1 + Acos(27t)), where B => 0 and 0 < A < 1. Plot phase portraits 


when A = 0. 18, a = 35. 84, y = 100, pp = 0. 02, and B = 1800 for the initial 
conditions: (i) S(0) = 0. 065, E(0) = 0. 00075, I(0) = 0. 00025, and (ii) S(O) = 
0. 038, E(0) = 3. 27 x 1078, 1(0) = 1. 35 x 10°®. Interpret the results for the 
populations. 


Plot some time series data for the Lorenz system (8.7) when o = 10, p = š 


and 166 < r < 167. When r = 166. 2, the solution shows intermittent 
behavior, and there are occasional chaotic bursts in between what looks 
like periodic behavior. 


10. 
Consider system (8.12) given in the text to model the periodic behavior of 


the Belousov-Zhabotinski reaction. By considering the nullclines and 
gradients of the vector fields, explain what happens to the solution curves 
for € ; < 1 and appropriate values of q and C. 
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9. Poincaré Maps and Nonautonomous 
Systems in the Plane 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


To introduce the theory of Poincaré maps. 

To compare periodic and quasiperiodic behavior. 

To introduce Hamiltonian systems with two degrees of freedom. 

To use Poincaré maps to investigate a nonautonomous system of differential 
equations. 


On completion of this chapter, the reader should be able to 


e understand the basic theory of Poincaré maps; 
e plot return maps for certain systems; 
e use the Poincaré map as a tool for studying stability and bifurcations. 


Poincaré maps are introduced via example using two-dimensional 
autonomous systems of differential equations. They are used extensively to 
transform complicated behavior in the phase space to discrete maps in a lower- 
dimensional space. Unfortunately, this nearly always results in numerical work 
since analytic solutions can rarely be found. 

A periodically forced nonautonomous system of differential equations is 
introduced, and Poincaré maps are used to determine stability and plot 
bifurcation diagrams. 

Discrete maps have been dealt with in Chapters 13—18 of the book. 


9.1 Poincare Maps 


When plotting the solutions to some nonlinear problems, the phase space can 


become overcrowded and the underlying structure may become obscured. To 
overcome these difficulties, a basic tool was proposed by Henri Poincaré [10] at 
the end of the 19th century. An historical introduction to Poincaré maps is given 
in [4] and some mathematical applications are discussed in [6]. As a simple 
introduction to the theory of Poincaré (or first return ) maps consider two- 
dimensional autonomous systems of the form 


x= P(x,y), ý= Q(x,y). 


(9.1) 

Suppose that there is a curve or straight line segment, say Ł, that is crossed 
transversely (no trajectories are tangential to X). Then X% is called a Poincaré 
section . Consider a point r ọ lying on X. As shown in Figure 9.1, follow the flow 


of the trajectory until it next meets X at a point r 4. This point is known as the 
first return of the discrete Poincaré map P: & > X, defined by 


Fn+1 = PC; 


where r „ maps to r ,,,, and all points lie on X. Finding the function P is 


equivalent to solving the differential equations (9.1). Unfortunately, this is very 
seldom possible, and one must rely on numerical solvers to make any progress. 


Figure 9.1 A first return on a Poincaré section, X. 


Definition 1. A point r * that satisfies the equation P(r *) = r * is called a 
fixed point of period one . 

To illustrate the method for finding Poincaré maps, consider the following 
two simple examples (Examples 1 and 2), for which P may be determined 
explicitly. 


Example 1. 
By considering the line segment X = {(x, y) € R? : 0 < x< 1,y = 0p find the 


Poincaré map for the system 


X=-y-xyxrt+y, yax- yy +y 


(9.2) 
and list the first eight returns on 2 given that r ọ = 1. 


Solution. Convert to polar coordinates. System (9.2) then becomes 


}=-r, O=1. 


(9.3) 
The origin is a stable focus and the flow is counterclockwise. A phase 
portrait showing the solution curve for this system is given in Figure 9.2. 
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Figure 9.2 [Python] A trajectory starting at (1, 0), (0 < t < 40) for system (9.3). 


The set of equations (9.3) can be solved using the initial conditions r(0) = 1 
and 6(0) = 0. The solutions are given by 


l 
r(t) = Tir Ot) =t. 


Trajectories flow around the origin with a period of 27. Substituting for t, the 
flow is defined by 


1 


r(t) = 1+ 4 


The flow is counterclockwise, and the required successive returns occur when 0 
= 2n, 4, .... A map defining these points is given by 


7 1 
= 1+2nz 


Fn 


on &, where n = 1, 2,.... As n > œ, the sequence of points moves towards the 
fixed point at the origin as expected. Now 

l 
1+2(n+ 1r 


Fn+1 = 


Elementary algebra is used to determine the Poincaré return map P, which may 
be expressed as 

Fn 

Fn+1 = P(r) a 1+ Zar, 

The first eight returns on the line segment £ occur at the points rg =1,r,=0. 
13730, r 5 = 0.07371, r 3 = 0. 05038, r 4 = 0. 03827, r s = 0. 03085, r ¢ = 0. 
02584, r 7 = 0.02223, and r g = 0.01951, to five decimal places, respectively. 


Check these results for yourself using the Python program at the end of the 
chapter. 


Example 2. 
Use a one-dimensional map on the line segment 
YX = {(x,y) E R? : 0 < x < œ, y = 0} to determine the stability of the limit 


cycle in the following system: 


x= -y+ xl- y2 +y), ýy=x+y(l- Vx? +y). 
(9.4) 


Solution. Convert to polar coordinates, then system (9.4) becomes 


r=rl—-n, @=1. (9.5) 


The origin is an unstable focus, and there is a limit cycle, say I’, of radius 1 
centered at the origin. A phase portrait showing two trajectories is given in 
Figure 9.3. 

System (9.5) can be solved since both differential equations are separable. 


The solutions are given by 


r(t) = —————£— Ot) = ft + bo, 
1+ 


Ce" 
where C and 0 9 are constants. Trajectories flow around the origin with a period 
of 27. 

Suppose that a trajectory starts outside I’ on Ł, say at r ọ = 2. The solutions are 
then given by 
l 
r(t) = r ot) =t. 
| — 7e 


=f 


Therefore a return map can be expressed as 


1 
EES = lo-2nr’ 
2 
where n is a natural number. If, however, a trajectory starts inside T at, say 
ro = L, then 


1 
D= —— sr, 
+e 


and a return map is given by 


1 


fo ie en2nn: 


Figure 9.3 Two trajectories for system (9.5), one starting at (2, 0) and the other at (0. 01, 0). 


In both cases r ,, > 1asn > œ. The limit cycle is stable on both sides, and the 
limit cycle [is hyperbolic stable since r „ > 1 as n > œ for any initial point 


apart from the origin. The next theorem gives a better method for determining 
the stability of a limit cycle. 


Theorem 1. 
Define the characteristic multiplier M to be 
_ dP 
— dr\e’ 


where r * is a fixed point of the Poincaré map P corresponding to a limit cycle, 
say I’. Then 


if |M |< 1, T is a hyperbolic stable limit cycle ; 


2. 
if | M | > 1, T is a hyperbolic unstable limit cycle ; 


if |M|=1, and ¿P _, ¢, then the limit cycle is stable on one side and 
dr? 


unstable on the other; in this case T is called a semistable limit cycle . 


Theorem 1 is sometimes referred to as the derivative of the Poincaré map test . 


Definition 2. A fixed point of period one, say r *, of a Poincaré map P is 
called hyperbolic if | M | # 1. 


Example 3._ Use Theorem 1 to determine the stability of the limit cycle in 
Example 2. 


Solution. Consider system (9.5). The return map along X is given by 


1 


Fn = n -a Aaa 
1+ Ce?” 


(9.6) 


where C is a constant. Therefore, 


i 


Ini = 14+ Ce720+))r' 


(9.7) 


Substituting Ç — Lm ẹ2"7 from equation (9.6) into (9.7) gives the Poincaré 
Fn 


map 

; Fn 
Fn+1 = P(r,) = a a 
ile 


The Poincaré map has two fixed points, one at zero (a trivial fixed point) and the 


other at r * = 1, corresponding to the critical point at the origin and the limit 
cycle I’, respectively. Now 


dP g 
dr (r+ (1 -rje 
using elementary calculus, and 
dP 


dr r*=] 


= e™”™™ x 0.00187 < 1, 


and so the limit cycle T is hyperbolic attracting. 


Definition 3. A point r * that satisfies the equation P "(r *) = r * is called a 
fixed point of period m . 


Example 4. 
Consider the circle map P defined by 


27 
fisi = P(r) =e Pn, 


which maps points on the unit circle to itself. Assuming that r ọ = 1, plot iterates 
when 


(a)q1,=9,q2=1, 
(b) gq, =1,q2=2, 
(c)q,=2,q>=3, and 


Explain the results displayed in Figures 9.4(a)—(d). 
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Figure 9.4 Fixed points of periods (a) one; (b) two; (c) three, and (d) quasiperiodic behavior, for the circle 
n7fl ai 
P Tt = PO) = en Fn 


Solution. In Figure 9.4(a), there is a fixed point of period one since r „+4 = P 
=r „ Similarly, in Figures 9.4(b)-(c), there are fixed points of periods two and 


three since r „2 = P ° =r „andr „+3 = P ° = r ,. For Figure 9.4(d), q ; and q 5 are 


rationally independent since c ; q 4 + €> q 2 = 0 with c , and c 5 integers is 
satisfied only by c 4 =c > = 0. This implies that the points on the circle map are 
never repeated and there is no periodic motion. (There is no integer c such that r 
nic = P| =r „). Figure 9.4(d) shows the first 1000 iterates of this mapping. If one 


were to complete the number of iterations to infinity, then a closed circle would 
be formed as new points approach other points arbitrarily closely an infinite 
number of times. This new type of qualitative behavior is known as 
quasiperiodicity . Note that one has to be careful when distinguishing between 
quasiperiodic points and points that have very high periods. For example, 
Figure 9.4(d) could be depicting a very high period trajectory. Systems 
displaying quasiperiodicity will be discussed in the next section. 


9.2 Hamiltonian Systems with Two Degrees of 
Freedom 


Hamiltonian systems with one degree of freedom were introduced in Chapter 6 
These systems can always be integrated completely. Hamiltonian (or 
conservative) systems with two degrees of freedom will be discussed briefly in 
this section, but the reader should note that it is possible to consider Hamiltonian 
systems with N—or even an infinite number of—degrees of freedom. 

In general, the set of Hamiltonian systems with two degrees of freedom are 
not completely integrable , and those that are from a very restricted but 
important subset. The trajectories of these systems lie in four-dimensional space, 
but the overall structure can be determined by plotting Poincaré maps. It is 
known that completely integrable systems display remarkable smooth regular 
behavior in all parts of the phase space, which is in stark contrast to what 
happens with nonintegrable systems, which can display a wide variety of 
phenomena including chaotic behavior. A brief definition of integrability is 
given below, and Hamiltonian systems with two degrees of freedom will now be 
defined. 


Definition 4. A Hamiltonian system with two degrees of freedom is 
defined by 


OH OH OH OH 
—, aee d2 = 
Og a OP| : 


a 


where H is the Hamiltonian of the system. In physical applications, q , and q 
> are generalized coordinates and p , and p » represent a generalized momentum. 
The Hamiltonian may be expressed as 


H(p, q) = KE. q) + Pe(q), 


where K p and P ç are the kinetic and potential energies, respectively. 


Definition 5. 
The Hamiltonian system with two degrees of freedom given by (9.8) is 
integrable if the system has two integrals, say F , and F 5, such that 


{F1, H} = 0, {F2, H} = 0, {F1, F2} = 0, 
where F , and F , are functionally independent and {, } are the so-called Poisson 
brackets defined by 
E OF | OF > OF | OF > 


Pe a a 
Ce o d 


Some of the dynamics involved in these type of systems will now be described 
using some simple examples. 


Example 5. 
Consider the Hamiltonian system with two degrees of freedom given by 
w] 9 2 a) ee) 
H(p.q) = 5 (Pi + qi) + > (P + 45): (9.9) 


which is integrable with integrals given by F,;=p,*+q,7andF,=p,5*+q> 
2. This system can be used to model a linear harmonic oscillator with two 
degrees of freedom. 
Plot three-dimensional and two-dimensional projections of the Poincaré surface- 
of-section for system (9.9) given the following set of initial conditions for p 4, p > 
and q 1,q 9: 

(i) @ 14 = @ > = 2 with the initial conditions t = 0, p ; = 0.5,p5=1.5,q,=0. 
9,4 2 = 0; 

(ii) œ ; = 8, œ 5 = 3 with the initial conditions t = 0, p ; = 0. 5,p 2 = 1.5,q1 = 
0.3,q>=90; 


(ili) o i= V2, w = 1 with the initial conditions t = 0, p 4 = 0.5,p»5=1. 
5,q1=0.3,q2=0. 


Solutions. A Python program is listed in Section 9.4 (see Figure 9.5). 
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Figure 9.5 [Python] Projections of the Poincaré surface-of-section for system (9.9) when (a)-(b) œ 1 = œ 
2 = 2, (QH(d) œ 1 = 8 and o 2 = 3, and (e)-(f) ns V2 and @ 9 = 1. The initial conditions are listed in 


(i)-(iii) of Example 5. 


The results may be interpreted as follows: in cases (i) and (ii) the solutions 
are periodic, and in case (iii) the solution is quasiperiodic. For the quasiperiodic 
solution, a closed curve will be formed in the p ; q ; plane as the number of 
iterations goes to infinity. The quasiperiodic cycle never closes on itself; 
however, the motion is not chaotic. Once more the trajectories are confined to 
invariant tori (see Figure 9.5(e), which shows a section of the torus). 
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Figure 9.6 A three-dimensional and two-dimensional projection of the Poincaré surface-of-section for the 
Hénon-Heiles system with the initial conditions t = 0, p 1 = 0.06, p 9 = 0. 1, q 1 =—0.2,q 7 = -0. 2. Note 


that the energy level is equal to 0. 041466 in this case. 
Example 6. 


Consider the Hénon-Heiles Hamiltonian system (which may be used as a simple 
model of the motion of a star inside a galaxy) given by 


3 

H(p. q) = “(ph +4) + P3 +9) + qig- 2. 
This Hamiltonian represents two simple harmonic oscillators (see Example 5(i)) 
coupled with a cubic term. The Hamiltonian in this case is nonintegrable. Plot 
three-dimensional and two-dimensional projections of the Poincaré surface-of- 
section of the Hamiltonian system for the set of initial conditions given by t = 
0,p , = 0. 06, p,=0.1,q,=—0.2,q,=-0.2. 
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Figure 9.7 The Poincaré transversal plane for the Hénon-Heiles Hamiltonian system with different energy 
levels. The smoothness of the curves in both (p,q) planes is related to the integrability of the system. 


Solution. See Figure 9.6. 

A rich variety of behavior is observed in the Poincaré section for the Hénon- 
Heiles system as the energy levels increase. For example, Figure 9.7 shows how 
the Poincaré section changes as the energy level increases from 0. 041666 to 0. 
166666. 

As the energy levels increase the closed orbits, representing quasiperiodic 
behavior, are replaced by irregular patterns, and eventually the Poincaré plane 
seems to be swamped by chaos. In fact, there is a famous theorem due to 
Kolmogorov, Arnold, and Moser, now known as the KAM theorem. Interested 
readers are referred to the book of Guckenheimer and Holmes [5]. 


Theorem 2. Suppose that a Hamiltonian system with two degrees of freedom 
is given by H = H ọ + £H ,, where £ is a small parameter, H g is integrable, and 
H , makes H nonintegrable. The quasiperiodic cycles (also known as KAM tori) 


, which exist for £ = 0, will also exist for 0 < € < 1 but will be deformed by the 
perturbation. The KAM tori dissolve one by one as € increases and points begin 
to scatter around the Poincaré plane. A similar pattern of behavior can be seen 
in Figure 9.7. 


9.3  Nonautonomous Systems in the Plane 


The existence and uniqueness theorems introduced in Chapter 2 hold for 
autonomous systems of differential equations. This means that trajectories 
cannot cross, and the Poincaré-Bendixson Theorem implies that there is no chaos 
in two dimensions. However, chaos can be displayed in three-dimensional 
autonomous systems as shown in Chapter 8, where various strange attractors 
were plotted using Python. This section is concerned with nonautonomous (or 
forced ) systems of differential equations of the form 


= f(x, x,t), 


where the function f depends explicitly on t. There is no longer uniqueness of the 
solutions, and trajectories can cross in the phase plane. For certain parameter 
values, the phase portrait can become entangled with trajectories crisscrossing 
one another. By introducing a Poincaré map, it becomes possible to observe the 


underlying structure of the complicated flow. 
As a particular example, consider the Duffing equation given by 


K+ ke + Bx tax =T cos(wt), 


where, in physical models, k > 0 is the damping coefficient, p is the stiffness, a is 
the nonlinear stiffness parameter, x is the speed of the mass, I" is the amplitude 


of force vibration, and q is the frequency of the driving force. Let x = y; then 
the Duffing equation can be written as a system of the form 
ž=y, p= —Bx—ky-ax +T cos(wt), 


(9.10) 

When £ < 0, the Duffing equation models a periodically forced steel beam 
deflected between two magnets [7], see Figure 9.8(a). When £ > 0, the Duffing 
equation models a periodically forced pendulum as depicted in Figure 9.8(b). 
When a > 0, the spring is called a hardening spring and when a < 0, the spring is 
called a softening spring. Consider the Poincaré map of system (9.10) as the 
amplitude I" varies when k, p, a, and œ are fixed. The radius of the limit cycle on 
the Poincaré section is given by r. 


a b 


T cos(at) 


Steel beam 


Magnets t X 
Figure 9.8 (a) A steel beam between two magnets. (b) A periodically driven pendulum. 


Systems of the form (9.10) have been studied extensively in terms of, for 
example, stability, harmonic solutions, subharmonic solutions, transients, chaotic 


output, chaotic control, and Poincaré maps. The work here will be restricted to 
considering the Poincaré maps and bifurcation diagrams for system (9.10) as the 
driving amplitude T varies when a = 1, $ = -1,k = 0.3, and œ = 1. 25 are fixed. 

It is interesting to apply quasiperiodic forcing to nonlinear systems, as in [9], 
where nonchaotic attractors appear for a quasiperiodically forced van der Pol 
system. 

Any periodically forced nonautonomous differential equation can be 
represented in terms of an autonomous flow in a torus. To achieve this 
transformation, simply introduce a third variable 0 = wt. System (9.10) then 
becomes a three-dimensional autonomous system given by 


x=y, ý= —-ßx-— ky- ax? +Icos(@), @=w. (9.11) 


A flow in this state space corresponds to a trajectory flowing around a torus with 
period 22. This naturally leads to a Poincaré mapping of a 0 = @ plane to itself 
w 


as depicted in Figure 9.9. 


Figure 9.9 The first return of a point P ọ to P 1 in the plane 0 = 6 ¢. The trajectories flow inside a torus in 


three-dimensional space. 


When I" = 0, system (9.10) has three critical points at M = (—1, 0), N = (1, 0), 
and O = (0, 0). The points M and N are stable foci when ọ < k < 2/2 and O is 


a saddle point. As I’ is increased from zero, stable periodic cycles appear from M 
and N and there are bifurcations of subharmonic oscillations . The system can 
also display chaotic behavior for certain values of I’. 

Only periodic cycles initially appearing from the critical point N will be 
considered here. A gallery of phase portraits along with their respective Poincaré 
return maps are presented in Figures 9.10 and 9.11. 

When T' = 0. 2, there is a period-one harmonic solution of period a, which 


is depicted as a closed curve in the phase plane and as a single point in the 6 = 0 


plane (see Figure 9.10(a)). When I’ = 0. 3, a period-two cycle of period 42 
w 
appears; this is a subharmonic of order 1. A period-two cycle is represented by 


two points in the Poincaré section (see Figure 9.10(b)); note that the trajectory 
crosses itself in this case. A period-four cycle of period 82 is present when I" = 
w 


0. 31 (see Figure 9.10(c)). When T = 0. 37, there is a period-five cycle that is 
centered at O and also surrounds both M and N (see Figure 9.11(a)). When I’ = 
0. 5, the system becomes chaotic. A single trajectory plotted in the phase plane 
intersects itself many times, and the portrait soon becomes very messy. 
However, if one plots the first returns on the Poincaré section, then a strange 
attractor is formed that demonstrates some underlying structure (see 

Figure 9.11(b)). It must be noted that the chaotic attractor will have different 
forms on different Poincaré sections. This strange (or chaotic) attractor has 
fractal structure. At T = 0. 8, there is once more a stable period-one solution. 
However, it is now centered at O (see Figure 9.11(c)). 
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Figure 9.10 A gallery of phase portraits and Poincaré maps for system (9.10) when a = 1,8 = -1,k = 0.3 
and œ = 1. 25: (a) I = 0. 2 (forced period one), (b) F = 0. 3 (a period-two subharmonic), and (c) F = 0. 31 (a 
period-four subharmonic). 


Figure 9.11 [Python] A gallery of phase portraits and Poincaré maps for system (9.10) when a = 1, B = 
-1, k = 0.3, and w = 1. 25: (a) I = 0. 37 (a period-five subharmonic); (b) I’ = 0. 5 (chaos), 4000 points are 
plotted; (c) F = 0. 8 (forced period one). 


Figures 9.10 and 9.11 display some of the behavior possible for the Duffing 
equation for specific values of the parameter I". Of course, it would be far better 
to summarize all of the possible behaviors as the parameter I" varies on one 
diagram. To achieve this goal, one must plot bifurcation diagrams. There are 
basically two ways in which bifurcation diagrams may be produced; one 
involves a feedback mechanism, the other does not. The first and second 
iterative methods are described in Chapter 16 

Figure 9.12 shows a possible bifurcation diagram for system (9.10) for 
forcing amplitudes in the range 0 < I< 1 near the critical point at N. The vertical 
axis labeled r represents the distance of the point in the Poincaré map from the 
origin (r = Vie +y The first iterative method was employed in this case. 


For each value of I’, the last 10 of 50 iterates were plotted, and the step length 
used in this case was 0. 01. The initial values were chosen close to one of the 
existing periodic solutions. The diagram shows period-one behavior for 0 < I" < 
0. 28, approximately. For values of I’ > 0. 28, there is period-two behavior, and 
then the results become a little obscure. 

Figure 9.13 shows a possible bifurcation diagram produced using the second 
iterative method. The parameter T is increased from zero to 0. 4 and then 
decreased from I = 0. 4 back to zero. A similar study was carried out in 
Chapter 5 There were 4000 iterates used as I’ was increased and then decreased. 
The solid curve lying approximately between 0 < I< 0. 32 represents steady- 
state behavior. As I’ increases beyond 0. 32, the system goes through a chaotic 
regime and returns to periodic behavior before I" = 0. 4. As the parameter T is 
decreased, the system returns through the periodic paths, enters a chaotic region, 
and period undoubles back to the steady-state solution at T % 0. 28. Note that on 
the ramp-up part of the iterative scheme, the steady state overshoots into the 
region where the system is of period two, roughly where 0. 28 < I’ < 0. 32. 


0 0.2 0.4 


Figure 9.12 A bifurcation diagram for system (9.10) when @ = 1, B = —1, k = 0.3, and œ = 1. 25, produced 
using the first iterative method. 


Figure 9.14 shows a bifurcation diagram produced as T is increased from 
zero to 0. 4002 and then decreased back to zero. Once more as I is increased, 
there is steady-state behavior for I lying between zero and approximately 0. 32. 
However, as the parameter is decreased a different steady state is produced and a 
large bistable region is present. 

Note that there will also be steady-state behavior and bifurcations associated 
with the critical point at M. The flow near to saddle fixed points will now be 
considered. 
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Figure 9.13 [Python] A bifurcation diagram for system (9.10) when a = 1, B = —1, k = 0. 3, and w = 1. 25, 
0 <T <0. 4, produced using the second iterative method. The ramp up points are colored red and the ramp 
down points are colored blue. 
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Figure 9.14 [Python] A bifurcation diagram for system (9.10) when a = 1, B = —1, k = 0. 3, and w = 1. 25, 
0 <T < 0. 4002, produced using the second iterative method. There is a large bistable region . The ramp up 
points are colored red and the ramp down points are colored blue. 
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Homoclinic and Heteroclinic Bifurcations . Some of the theory involved in 
the bifurcations to chaos for flows and maps is a result of the behavior of the 
stable and unstable manifolds of saddle points. Discrete maps have been 
discussed in some detail in earlier chapters. The stable and unstable manifolds 
can form homoclinic and heteroclinic orbits as a parameter is varied. Homoclinic 
and heteroclinic orbits were introduced in Chapter 6 It is also possible for the 
stable and unstable manifolds to approach one another and eventually intersect 
as a parameter varies. When this occurs, there is said to be a homoclinic (or 
heteroclinic) intersection. The intersection is homoclinic if a stable/unstable 
branch of a saddle point crosses the unstable/stable branch of the same saddle 
point, and it is heteroclinic if the stable/unstable branches of one saddle point 
cross the unstable/stable branches of a different saddle point. If the stable and 
unstable branches of saddle points intersect once, then it is known that there 
must be an infinite number of intersections, and a so-called homoclinic (or 
heteroclinic) tangle is formed. In 1967, Smale [11] provided an elegant 
geometric construction to describe this phenomenon. The mapping function used 
is now known as the Smale horseshoe map . Consider a small square, say S, of 
initial points surrounding a saddle point in the Poincaré section. Under the 
iterative scheme, this square of points will be stretched out in the direction of the 
unstable manifold and compressed along the stable branch of the saddle point. In 
Smale’s construction, a square of initial points is stretched in one direction and 


then compressed in an orthogonal direction. Suppose that the map is given by 
H : S — R? and that H contracts S in the horizontal direction, expands S in the 


vertical direction, and then folds the rectangle back onto itself to form a 
horseshoe, as in Figure 9.15. Similarly, the action of H ~t on S is also given in 
Figure 9.15. The result of the intersection of these first two sets is given in 
Figure 9.16. 


H!(S) 1 SC H(S) 


Figure 9.16 The first stage of the Smale horseshoe map. 


As this process is iterated to infinity, points fall into the area contained by 
the original square in smaller and smaller subareas. The result is an invariant 
Cantor set that contains a countable set of periodic orbits and an uncountable set 
of bounded nonperiodic orbits. 

The Smale-Birkhoff Theorem states that homoclinic tangles guarantee that a 
dynamical system will display horseshoe dynamics . For more details, the reader 
is directed once again to the excellent textbook of Guckenheimer and Holmes 


[5]. 


9.4 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


Axes3D(fig) # Set properties of 3D axes. 
ax.set_title |# Put a title on 3D axes. 


# Program 09a: Poincare first return map. 
# See Figure 9.2. 

import matplotlib.pyplot as plt 

from sympy import sqrt 

import numpy as np 

from scipy.integrate import odeint 


xmin, xmax -1, 1 
ymin, ymax -1, 1 
def dx_dt(x, t): 
return [- x[1] - x[0] sqrt(x[0]*2 + x[1]**2), 
x[0] - x[1] sqrt(x[o]*2 + x[1]**2)] 


# Phase portrait. 
t=np.linspace(0,16*np.pi, 10000 ) 
xs=odeint(dx_dt, [1, 0], t) 
plt.plot(xs[:, O], xs[:, 1], "r-") 
plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.xLlim(xmin, xmax) 
plt.ylim( ymin, ymax); 


# First eight returns on x-axis. 
t = np.linspace(0, 9*2*np.pi, 900000) 
xs = odeint(dx_dt, [1, 0], t) 
for i in range(Q9): 
print(’r{} = {}’.format(i, xs[100000*1i, 0])) 
plt.show() 


# Program 09b: Hamiltonian with two degrees of free 
dom. 
# See Figure 9.5(e). 


import numpy as np 


from scipy.integrate import odeint 

from sympy import sqrt 

import matplotlib.pyplot as plt 

from mpl_toolkits.mplot3d import Axes3D 


# Maximum time point and total number of time point 
S 

tmax, n = 100, 20000 

w1 = sqrt(2) 

w2 = 1 


def hamiltonian_4d(X, t): 
p1, p2, qi, q2 = X 
dpi = -w1* qi 
dp2 -W2 * q2 
dqi = wi * pl 
dq2 = w2 * p2 
return (dpi, dp2, dqi, dq2) 


t np.linspace(0, tmax, n) 
f odeint(hamiltonian_4d, (0.5, 1.5, 0.5, 0), t) 
p1, p2, qi, q2 = f.T 


fig=plt.figure() 
ax = Axes3D(f1ig) 


ax.plot(pi, qi, q2,’b-’, lw=0.5) 
ax.set_xlabel(r’$p_1$’, fontsize=15) 
ax.set_ylabel(r’$q_1$’, fontsize=15) 
ax.set_zlabel(r’$q_2$’, fontsize=15) 
plt.tick_params(labelsize=12 ) 
ax.set_title(’H=1.365416, fontsize=15) 
plt.show() 


# Program 09c: Phase portrait and Poincare map of a 
nonautonomous ODE. 

# See Figure 9.11(b). 

import matplotlib.pyplot as plt 

import numpy as np 


from scipy.integrate import odeint 


xmin, xmax = -2, 2 
ymin, ymax = -2, 2 
k = 0.3 

omega = 1.25 

gamma = 0.5 


def dx_dt(x, t): 
return [x[1], x[0] - k * x[1] - x[0]**3 + gamma 
np.cos(omegat ) | 


# Phase portrait. 

t = np.linspace(0, 500, 10000) 

xs = odeint(dx_dt, [1, 0], t) 
plt.plot(xs[:, 0], xs[:, 1], "r-", lw=0.5) 
plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.xLlim(xmin, xmax) 

plt.ylim( ymin, ymax); 

plt.title(’Phase portrait’) 


# The Poincare section. Plot 4000 points. 

x = [] 

y = [] 

fig, ax = plt.subplots(figsize=(6, 6)) 
t=np.linspace(0, 4000*(2*np.pi)/omega, 16000000) 
xs = odeint(dx_dt, [1, 0], t) 


[xs[4000*i, ©] for i in range(4000)] 
[xs[4000*i, 1] for i in range(4000)] 


ax.scatter(x, y, color = ‘blue’, s=0.1) 
plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.title(’The Poincare section’ ) 
plt.show() 


# Program 09d: Bifurcation diagram of the Duffing e 
quation. 
# See Figure 9.14. 


import matplotlib.pyplot as plt 
import numpy as np 
from scipy.integrate import odeint 


rs_up=[ ] 
rs_down=[ ] 


def duffing(x, t): 
return [x[1], - 
beta x[0] - k x[1] - alpha x[0] *3 + \ 
gamma np.cos(omegat) |] 


# Take N_steps=4000 to get Figure 9.13. 
num_steps = 4002 

step = 0.0001 

interval = num_steps * step 

a, b=41, © 

ns=np.linspace(0,num_steps, num_steps) 


# Ramp the amplitude of vibration, Gamma, up. 
for n in ns: 
gamma = step * n 
t = np.linspace(0, (4*np.pi) / omega, 200) 
xs = odeint(duffing, [a, b], 
for i in range(2): 


a = xs[100, 0] 
b = xs[100, 1] 
r = np.sqrt(a**2 + b**2) 


rs_up.append([n, r]) 


rs_up = np.array(rs_up) 


# Ramp the amplitude of vibration, Gamma, down. 
for n in ns: 
gamma = interval - step * n 
t=np.linspace(0, (4*np.pi) / omega, 200) 
xs=odeint(duffing, [a, b], 
for i in range(2): 
a=xs[100, 0] 
b=xs[100, 1] 
r=np.sqrt(a**2 + b**2) 
rs_down.append([num_steps - n, r]) 


rs_down=np.array(rs_down) 


fig, ax = plt.subplots() 
xtick_labels = np.linspace(0, interval, 5) 
ax.set_xticks([x / interval * num_steps for x in xt 
ick_labels] ) 
ax.set_xticklabels([’{:.1f}’.format(xtick) for \ 
xtick in xtick_labels]) 


plt.plot(rs_up[:, 0], rs_up[:, 1], ‘r.’, markersize 
=0.1) 

plt.plot(rs_down[:, 0], rs_down[:, 1], ’b.”, marker 
size=0.1) 

plt.xlabel(r’$\Gamma$’, fontsize=15) 

plt.ylabel(’r’, fontsize=15) 

plt.tick_params(labelsize=15) 

plt.show() 


9.5 Exercises 


Consider the system 


X=-y-O.lx.fxety*, yp=x-O.lys/x? ty’. 


By considering the line segment X = {(x, y) E€ R? : 0 < x< 4,y = 0p list 


the first ten returns on 2 given that a trajectory starts at the point (4, 0). 


a) 


Obtain a Poincaré map for the system 


X= pxty-—xfx?+y’, y=-x+yy-y [x2 + y? 


on the Poincaré section X = {(x,y)€R?7:0<x< co, y = 0} 


Use the characteristic multiplier to determine the stability of the limit cycle 
in Example 2. 


Solve the following differential equations: 

r=r1—-r’), O=1. 
Consider the line segment X = {(x, y) € R? : 0 < x < oo} and find the 
Poincaré map for this system. 


Use the characteristic multiplier to determine the stability of the limit cycle 
in Example 4. 


Consider the two degrees of freedom Hamiltonian given by 
Wi, 9 2 w2 2 
HP, g) = Fi + 1) +5 P +a). 


Plot three-dimensional and two-dimensional Poincaré sections when 
(a) œw; =3and o , = 7 for the set of initial conditions t = 0, p 4 = 0. 5,p > 


=1.5,q1=0.5,q2=0, 
b) w = v2 and @ » = 3 for the set of initial conditions t = 0, p 4 = 0. 


5,Pp2=1.5,q1=0.5,q2=0. 
. Plot three-dimensional and two-dimensional Poincaré sections of the Toda 
Hamiltonian given by 

pP p enta e234 e74 e] 


H + + — + —_—__ + l 
2 2 24 24 24 8 


for several different energy levels of your choice. 


8. Plot the chaotic solution of the periodically driven Fitzhugh-Nagumo system 


10. 


3 
j= 1ou-v- 5 +10); par- 00T 


where I(t) is a periodic step function of period 2. 025, amplitude 0. 267, and 
width 0. 3. 


A damped driven pendulum may be modeled using the nonautonomous 
system of differential equations defined by 
0 dð g 


2 Sq — r , 
J2 + k + 7 sin(@) cos(wt), 


where k is a measure of the frictional force, F and œ are the amplitude and 
frequency of the driving force, g is the acceleration due to gravity, and l is 
the length of the pendulum. Plot a Poincaré map for this system when k = 
0.3, r = 4.5, œ = 0.6, and Z = 4. 


(a) Consider system (9.10) with a= 1, p = —1, k = 0. 1, and œ = 1. 25. Plot a 
bifurcation diagram for 0 < I < 0. 1 and show that there is a clockwise 
hysteresis loop at approximately 0. 04 < T < 0. 08. Note that there is 
ringing (oscillation) at the ramp-up and ramp-down parts of the bistable 
region . 

(b) Plot the two stable limit cycles in the bistable region for Exercise 
10(a) on one phase portrait. This shows that the system is multistable . For 
example, take T = 0. 07. These limit cycles correspond to steady states on 
the upper and lower branches of the bistable cycle. 
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10. Local and Global Bifurcations 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To introduce some local and global bifurcation theory in the plane. 
e To bifurcate limit cycles in the plane. 
e To introduce elementary theory of Grébner bases. 


On completion of this chapter, the reader should be able to 


bifurcate small-amplitude limit cycles from fine foci; 

solve systems of multivariate polynomial equations; 

bifurcate limit cycles from a center; 

investigate limit cycle bifurcation from homoclinic loops, numerically. 


The problem of determining the maximum number of limit cycles for planar 
differential systems dates back more than 100 years and will be discussed in 
more detail in Chapter 11 Local limit cycles can be analyzed in terms of local 
behavior of the system near to a relevant critical point or limit cycle. The theory 
involved in global bifurcations is not so well developed and involves larger-scale 
behavior in the plane. 

An algorithm is presented for bifurcating small-amplitude limit cycles out of 
a critical point. Grébner bases are then introduced which can help with the 
reduction phase of the algorithm. The Melnikov function is used to determine 
the approximate location and number of limit cycles when a parameter is small. 
The limit cycles are bifurcated from a center. Bifurcations involving homoclinic 
loops are discussed in Section 10.4. 


10.1 Small-Amplitude Limit CycleBifurcations 


The general problem of determining the maximum number and relative 
configurations of limit cycles in the plane has remained unresolved for over a 
century. The problem will be stated in Chapter 11 Both local and global 
bifurcations have been studied to create vector fields with as many limit cycles 
as possible. All of these techniques rely heavily on symbolic manipulation 
packages such as Python. Unfortunately, the results in the global case number 
relatively few. Only in recent years have many more results been found by 
restricting the analysis to small-amplitude limit cycle bifurcations; see, for 
example, Chapter 11 and the references therein. 

Consider systems of the form 


x= P(x,y), ý= Q(x,y), (10.1) 


where P and Q are polynomials in x and y. It is well known that a 
nondegenerate critical point , say, X 9, of center or focus type can be moved to 


the origin by a linear change of coordinates to give 
x= Ax- y+ phx, y), y=x+Ay+q(x,y), (10.2) 


where p and q are at least quadratic in x and y. If A # 0, then the origin is 
structurally stable for all perturbations. 


Definition 1. A critical point, say, x 9, is called a fine focus of system (10.1) if 
it is a center for the linearized system at x 9. Equivalently, if A = 0 in system 
(10.2), then the origin is a fine focus. 


In the work to follow, assume that the unperturbed system does not have a center 
at the origin. The technique used here is entirely local; limit cycles bifurcate out 
of a fine focus when its stability is reversed by perturbing A and the coefficients 
arising in p and q. These are said to be local or small-amplitude limit cycles. 
How close the origin is to being a center of the nonlinear system determines the 
number of limit cycles that may be obtained from bifurcation. The method for 
bifurcating limit cycles will now be summarized and is given in detail in [15] 
and [11]. 

By a classical result, there exists a Lyapunov function , say, V (x, y) = V 
(X,Y) + V 3(x, y) +... + V X, y) +..., where V; is a homogeneous polynomial 
of degree k, such that 
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where r? =x? + y 2. The n 5; are polynomials in the coefficients of p and q and 
are called the focal values . The origin is said to be a fine focus of order k if n 5 = 
Ng = +e) =N 2, = 0 butnn 9445 Z 0. Take an analytic transversal through the origin 
parameterized by some variable, say, c. It is well known that the return map of 
(10.2), c > h(c), is analytic if the critical point is nondegenerate. Limit cycles of 
system (10.2) then correspond to zeros of the displacement function , d(c) = h(c) 
— c; see Chapter 9 Hence at most k limit cycles can bifurcate from the fine focus. 
The stability of the origin is clearly dependent on the sign of the first nonzero 
focal value, and the origin is a nonlinear center if and only if all of the focal 
values are zero. Consequently, it is the reduced values, or Lyapunov quantities , 
say, L(j), that are significant. One needs only consider the value n > reduced 
modulo the ideal (7 2, N 4 --- N 2-2) to obtain the Lyapunov quantity L(k — 1). 
To bifurcate limit cycles from the origin, select the coefficients in the Lyapunov 
quantities such that 


Law| « |L(m+ 1) and L(m)L(m + 1) < 0, 


for m = 0, 1,...,k— 1. At each stage, the origin reverses stability and a limit 
cycle bifurcates in a small region of the critical point. If all of these conditions 
are satisfied, then there are exactly k small-amplitude limit cycles. Conversely, if 
L(k) # 0, then at most k limit cycles can bifurcate. Sometimes it is not possible to 
bifurcate the full complement of limit cycles; an example is given in [10]. 

The algorithm for bifurcating small-amplitude limit cycles may be split into the 
following four steps: 


1. 
computation of the focal values using a mathematical package; 


reduction of the n-th focal value modulo a Gröbner basis of the ideal 
generated by the first n — 1 focal values (or the first n — 1 Lyapunov 
quantities); 


checking that the origin is a center when all of the relevant Lyapunov 
quantities are zero; 


bifurcation of the limit cycles by suitable perturbations. 


Dongming Wang [17] has recently developed software to deal with the 
reduction part of the algorithm for several differential systems and Grébner 
bases are introduced in the next section. 

For some systems, the following theorems can be used to prove that the 
origin is a center. 

The Divergence Test. Suppose that the origin of system (10.1) is a critical 
point of focus type. If 


YP) OWQ) _ 
ae Oy = 0, 


where y : R? — §R?, then the origin is a center. 


div (WX) = 


The Classical Symmetry Argument. Suppose that A = 0 in system (10.2) and 
that either (i) p(x, y) = —p(x, ~y) and q(x, y) = q(x, —y) or (ii) p(x, y) = p(-x, y) and 
q(x, y) = —q(-x, y). 

Then the origin is a center. 

Adapting the classical symmetry argument, it is also possible to prove the 
following theorem. 


Theorem 1. 
The origin of the system 
. G(x) 
xK=y-F(GQ)), ý= ——_ AIG), 
where F and H are polynomials, G(x) = f 9 * g(s)ds with g(x)sgn(x) > 0 for x # 0, 
g(0) = 0, is a center. 


The reader is asked to prove this theorem in the exercises at the end of the 
chapter. 

To demonstrate the method for bifurcating small-amplitude limit cycles, 
consider Liénard equations of the form 


k=y—F(x), y=—gx), (10.4) 


where F(x) =a ,xXt+a x7+...+a,xX"4and g(x)=x+byx2+by3xit...+b, 


x Y. This system has proved very useful in the investigation of limit cycles when 
showing existence, uniqueness, and hyperbolicity of a limit cycle. In recent 
years, there have also been many local results; see, for example, Table 11.1 in 


Chapter 11 Therefore, it seems sensible to use this class of system to illustrate 
the method. 

The computation of the first three focal values will be given and a Python 
program for computing the first two nontrivial focal values is listed in 


Section 10.5. Write V Kx, y) = È j= Vij xy! and denote V ; ; as being odd or 
even according to whether i is odd or even and that V ; j is 2-odd or 2-even 


according to whether j is odd or even, respectively. Solving equation (10.4), it is 
easily seen that y, = 1( x? + y>) and n 3 = -a 4. Therefore, set a ; = 0. The odd 


and even coefficients of V 3 are then given by the two pairs of equations 


3V3 0 = 2Vi2 = bo, 


Vio = 0 

and 
-V21 = ao, 
2V21 — 3Vo3 = O, 


respectively. Solve the equations to give 


1 2 
V3 = zb = anXx"y = zay”. 


Both 7 4 and the odd coefficients of V , are determined by the equations 


—14 — V3) = 4, 
—274 + 3 V31 = 3Vi3 = —2ab, 
-q4 + Vi} = 0. 


The even coefficients are determined by the equations 


4V40 = 2V29 b3 = 2a, 
2V22 —4AVo4 = 0 


II 


and the supplementary condition V 5 5 = 0. In fact, when computing 
subsequent coefficients for V 4m, it is convenient to require that V 5, 2m = 0. This 
ensures that there will always be a solution. Solving these equations gives 


1 
V, = 7% — 2a5)x* — (4 + a3)x°y + axy” 
and 
1 
74 = geb = 3a). 
Suppose that 7 4 = 0 so that q} = mbr It can be checked that the two sets of 


equations for the coefficients of V ; give 


5 3 


8a; 7 4a, 2azb3 g 3 
5 3 Fe 


+ (a — a4)xty + | — + 


15 15 15 


k 8a4 taha) 5 
y”. 


The coefficients of V may be determined by inserting the extra condition V , 5 
+ V>4= 0. In fact, when computing subsequent even coefficients for V 4m+2, the 
extra condition V 9m 2m+2 + V 2m+2,2m = 9 is applied, which guarantees a 
solution. The polynomial V ¢ contains 27 terms and will not be listed here. 
However, n ¢ leads to the Lyapunov quantity 

L(2) = 6az2b4 — 10az2b2b3 + 20agb> — 1Sas. 
Lemma 1. The first three Lyapunov quantities for system ( 10.4 ) are L(0) = -a 
p» L(A) = 2a b- 3a 3, and L(2) = 6a b 4- 10a b,b3+20a 4b,- 15a s. 
Let Ĥ(u, y) denote the maximum number of small-amplitude limit cycles that 


can be bifurcated from the origin for system (10.4). 


Example 1. Prove that 
(i) (3,2) = 1 and 


(ii) (3,3) =2 


for system (10.4). 


Solutions. (i) Consider the case where u = 3 and v = 2. Now L(0)=0 if a ; = 0 
and L(1) = Oif q} = abr Thus system (10.4) becomes 


2 
. 2 . p) 
*ž = y- axí — zab, yý = =x — box’, 


and the origin is a center by Theorem 1. Therefore, the origin is a fine focus of 
order one if and only if a į = 0 and 2a , b 5 — 3a 3 0. The conditions are 


consistent. Select a 3 and a , such that 
IL(O)| « |IL(1)] and =L(O)LC1) < 0. 


The origin reverses stability once and a limit cycle bifurcates. The perturbations 
are chosen such that the origin reverses stability once and the limit cycles that 
bifurcate persist. Thus 77(3,2) = 1. Figure 10.1(a) shows a small-amplitude 


limit cycle for system (10.4) when u = 3 and v= 2. 
(ii) Consider system (10.4) with u = 3 and v= 3. Now L(0) = 0 if a į = 0, L(1) = 
Oif a; = fab» and L(2) = 0 ifa > b b 3 = 0. Thus L(2) = 0 if 


(a)a=0, 
(b) b 3 =0, or 
(c)b,=0. 


If condition (a) holds, then a 3 = 0 and the origin is a center by the 


divergence test (divX = 0). If condition (b) holds, then the origin is a center since 
Ĥ (3,2) = 1- If condition (c) holds, then a 3 = 0 and system (10.3) becomes 


= y— ax’, ý = -x-b3x, 


and the origin is a center by the classical symmetry argument. The origin is 
thus a fine focus of order two if and only if a į = 0 and 2a, b  — 3a > = 0 but a > 


b „b > 4 0. The conditions are consistent. Select b 3, a 3, and a 4 such that 
LDI « ILODI, LDL) <0 and |L(O)| « IL), LOL) < 0. 


The origin has changed stability twice, and there are two small-amplitude 
limit cycles. The perturbations are chosen such that the origin reverses stability 


twice and the limit cycles that bifurcate persist. Thus 77(3,3) = 2. 


Figure 10.1(b) shows two small-amplitude limit cycles for system (10.4) when u 
= 3 andv=3. 


a 


y(t) 


Figure 10.1 Small-amplitude limit cycles (blue trajectories) for system (10.4): (a) one limit cycle when u 
=3andv=2 anda ,=0.01,a9=1,b5=1, and a3 = 1; (b) two limit cycles when u = 3 and v = 3 and 


a, = 0.01,a. = 1,bo = lag = 1,and b g=, 


The algorithm for bifurcating limit cycles for Liénard systems can be 
extended to generalized Liénard systems, as demonstrated in [12, 13, 14]. 


10.2 Grobner Bases 


The field of computer algebra has expanded considerably in recent years and 
extends deeply into both mathematics and computer science. One fundamental 
tool in this new field is the theory of Grébner bases [1, 6, 18]. In 1965, as part of 
his PhD research studies, Bruno Buchberger [5] devised an algorithm for 
computing Grébner bases for a set of multivariate polynomials. The Gröbner 
bases algorithm was named in honor of his PhD supervisor Wolfgang Grébner. 
The most common use of the Grobner bases algorithm is in computing bases 
which can be related to operations for ideals in commutative polynomial rings. 
Most mathematical packages now have the Buchberger algorithm incorporated 
for computing Grébner bases and Python is no exception. This section aims to 
give a brief overview of the method including some notation, definitions, and 


theorems without proof. Introductory theory on commutative rings and ideals 
and proofs to the theorems listed in this section can be found in most of the 
textbooks in the reference section of this chapter. There are a wide range of 
applications, see [4], for example; however, for this text we will be interested in 
Grobner bases in polynomial rings in several variables only. The theory of 
Grobner bases originated with the desire to solve systems of nonlinear equations 
involving multivariate polynomial equations. Wang et al. [16, 17] have used 
Grébner bases among other methods to test elimination algorithms when solving 
multivariate polynomial systems. One interesting unsolved example appears in 
[16], when attempting to prove complete center conditions for a certain cubic 
system. 

Recall some basic algebraic definitions: 


Definition 2. 
A ring , say, (R, +, *) is a set R with two binary operations + and *, satisfying 
the following conditions: 


1. 
(R, +) is an Abelian group; 


2. 
(R, *) is a semigroup, and 


3. 
the distributive laws hold. 


If (R, +) is commutative, then (R, +, *) is called a commutative ring . 


Definition 3. A nonempty subset I C (R, +, *) is called an ideal if for all r € 
Randa€Il,r*a€lIanda*reé€El. 


Notation. Let N denote the set of nonnegative integers N = {0,1,2,...}. Let 
@ = (@,Q9,...,@,) be a power vector in N”, and let x ,,X5,...,X , be any n 


variables. Write x® = a7 x57 ...x5", where |a| = (a, + a2 +... + @;,) is the 


total degree of the monomial x “. Let R = K[x] = K [x1, X2,..., Xn] bea 


commutative polynomial ring in n variables over an algebraically closed field K 
such as C, Q, or R. Recall that a field is an algebraic structure in which the 


operations addition, subtraction, multiplication, and division (except by zero) 


may be performed. 


Definition 4. 
Let P = {p\, P2,---, Ps} be a set of multivariate polynomials, then the ideal 


generated by P, denoted by I = (P), is given by: 


{dim : TES iosal E xis}. 
i=1 


where the polynomials p ; form a basis for the ideal they generate. 


In 1888, David Hilbert proved the following theorem: 


Theorem 2. (Hilbert’s Bases Theorem). If K is a field, then every ideal in the 
polynomial ring K[x] is finitely generated. 

A proof to this theorem can be found in most textbooks in the reference 
section of this chapter. 


An extremely useful basis of an ideal is the Gröbner basis, which will be defined 
after the notion of monomial ordering is introduced. 


Definition 5. 


A monomial order, say, >, is a total order on the monomials of R such that 


i forall œ € N”, æ > 0; 
2. 
for all a, 6, y € N”, a > B implies that a + y > p + y. 


The three most common monomial orderings are defined by the following: 


Definition 6. 
Suppose that a, 6 € N”. Then the 


1. 
lexicographical order is such that, a >),, P if and only if the left-most 


nonzero entry in a —f is positive; 
2. 


degree lexicographical order is such that, a > 4), P if and only if | a | > |£ | 
or (Jal = Gl and œ > lex p); 


degree reverse lexicographical order is such that, @ > 4revlex P if and only if | 
a |> || or (læ| = || and the right-most nonzero entry in a —f is negative. 


Note that there are many other monomial orderings including weighted and 
grouped orders [8]. 


Example 2. 

Suppose that x *=x?y3z,xP=x2y4z2, andx” = xy ©z. Then 

1. 
(3, 3, 1) =a >},, É = (2, 4, 2) since in (a -f) = (1, —1, -1), the left-most 
nonzero entry is positive. Hence x 3 y 3 Z >), X? y4z?. 
(i) B = (2, 4, 2) ~aex & = (3, 3, 1) since | B | = 8 >| a| = 7. Hence x? y 4z? 
alex X? y? z. (ii) B = (2, 4, 2) =alex Y = (1, 6, 1) since | £ | = | y | = 8 and in ($ 
-y) = (1, -2, 1), the left-most nonzero entry is positive. Hence x ° y 4 z ? 
™dlex XY Z. 


(i) B = (2, 4, 2) =arevlex & = (3, 3, 1) since | B| =8 > |a| =7. Hence x? y 4z? 
™drevlex X 1y i Z. (ii) y= (1, 6, 1) > drevlex B = (2, 4, 2) since | Y | = | B | = 8 and 
in (y -B) = (-1, 2, -1), the right-most nonzero entry is negative. Hence xy ê z 
= x2 y4z? 

revlex : 


Definition 7. 

Assume that there is a fixed term order > on a set of monomials that uniquely 
orders the terms in a given nonzero polynomial p = © «€ g X“ € K[x]. Define 
the 


1. 
multidegree of p as multideg(p) = max (œ € N” : ca # 0); 


2. 
leading coefficient of p as LC(p) = c multideg(p)> 


3. 


leading monomial of p as LM(p) = x ™tdes©), 


4. 
leading term of p as LT(p) = LC(p)LM(p); 


Example 3. 

Suppose that p(x, y, Z) = 2x 3 y 3 z + 3x? y 4z? - 4xy ô z, then 

e with respect to +),,, multideg(p) = (3, 3, 1), LC(p) = 2, LM(p) = x? y ?z, 
LT(p) = 2x? y%z; 

e with respect to + g-,, multideg(p) = (2, 4, 2), LC(p) = 3, LM(p) = x? y4z2, 
LT(p) = 3x? y4z?; 

e with respect to >greviex Multideg(p) = (1, 6, 1), LC(p) = -4, LM(p) = xy êz, 
LT(p) = —4xy ê z. 


Definition 8. 
A polynomial f is reduced with respect to P = {p\, P2,.--, Ps} (or modulo P ), f 


> p h, if and only if there exists p ; E€ P, such that 


Furthermore, a polynomial g is completely reduced with respect to P if no 
monomial of g is divisible by any of the LM (p;), for all 1 <i<s. 


Division Algorithm for Multivariate Polynomials. Let P = {p), p2,..., Ps} 
be an ordered set of polynomials in K[x], then there exist polynomials q 4, q 2, 
-q r E Kx] such that for p E€ K[x] 

P = qipi + q2P2 +... + 4sPs tr, 


and either r = 0 or r is completely reduced with respect to P. The algorithm is 
described briefly here and is a generalization of the division algorithm in K [x | 


. Perform the reduction of p modulo p 4, P »,..., p , by repeatedly applying the 


following procedure until doing so leaves p unchanged. Take the smallest i such 
that a; = LT (p;) divides one of the terms of p. Let f be the largest (with respect 


to some monomial ordering > ) term of p that is divisible by a ,, replace p by 
p- ( £ ) p? the process eventually terminates. For a more detailed explanation 
aj 


see the textbooks at the end of the chapter. 

When dealing with large ordered sets of polynomials with high total degrees 
one must use computer algebra. There is a command in Python for carrying out 
the division algorithm. The syntax is sympy.polys.polytools.reduced(f, G, gens, *args) 

which reduces a polynomial f modulo a set of polynomials G. Given a 
polynomial f and a set of polynomials G = (f,,...,f,,), Python computes a set of 


quotients q = (q 4, --- q n) and the remainder r such that f=q,*f,+...+q,* 
fn + r, where r vanishes or r is a completely reduced polynomial with respect to 
G. 


Example 4. Fix a lexicographical order x >),, Y ~Jex Z. (i) Divide the 


polynomial f = x 4 + y + + z 4 by the ordered list of polynomials | ery zy- l, 


r= 2}. (ii) Repeat the division with the divisors listed as ly —2 ey], 


x? + y} 


Solution. The Python commands are listed in Section 10.5. Using the reduced 
command in Python one obtains 


(Gi) xtt+yt+zt = ~ - y) (x° + y) + (2 + y?) (2y -= 1) + 
(2y + y’) (y — z’) +242; 
(ii) xt + yt +z = (=x +y +r +yz ty + z) (y — z) +0 (2y = 1) 
+ ee — z?) (x? + y) + 2z* + 2°, 
Note that the remainders are different. Unfortunately, the division algorithm for 


multivariate polynomials does not produce unique remainders. However, all is 
not lost, unique remainders exist when the basis of the ideal is a Grobner basis. 


Definition 9. 
The lowest common multiple (LCM) of two monomials ,°!;°? ... +®" and 
ie ae 


rare o. yon is given by 


LCM (x°, xf) = ae a o. a npn) 


n 


Definition 10. 

The S-polynomial of two nonzero ordered polynomials f, g E€ K[x] is defined by 
T Te LCM(LM(f), LM(g)) , .LCM(LM(f), LM(g)) : 

7 LT(f) LT(g) g 


(10.5) 


The S-polynomials are constructed to cancel leading terms. The function in 
Python for computing S-polynomials is: 


def s_polynomial(f,g): 
return expand(lcm(LM(f), LM(g))* 
(1/LT(f)*f - 1/LT(g)*g)) 


Example 5. The Python program for computing the S-polynomial is listed in 
Section 10.5. Suppose that p = x — 13y °? - 12z ? and 7 = x °? — xy + 92z, 
determine S (p, 7t) with respect to the term order X >jex Y ~jex Z- 


Solution. Substituting into equation (10.5) 
2 2 
a. e e 19 a 2 - 
S (p.m) == (x — 13y? - 122°) a (x? — xy + 92z). 
Hence 
S(p, n) = —13xy* — 12x7? + xy — 92z 


and the leading terms of p and z have canceled. 
The following theorem gives rise to Buchberger’s algorithm: 


Theorem 3 (Buchberger’s Theorem). 
Let G = {g|, 22,..., 8s} be a set of nonzero polynomials in K[x], then G is a 


Grobner basis for the ideal I = (G) if and only if for all i 4 j, 


S (gi. g) eO, 


Buchberger’s Algorithm to Compute Gröbner Bases. The algorithm is used 
to transform a set of polynomial ideal generators into a Gröbner basis with 
respect to some monomial ordering. Suppose that P = {p), p2,- .-, Py} isa set 


of multivariate polynomials with a fixed term order >. 

Step 1. Using the division algorithm for multivariate polynomials (the reduced 
command in Python), reduce all of the possible S-polynomial combinations 
modulo the set P. 

Step 2. Add all nonzero polynomials resulting from Step 1 to P, and repeat 
Steps 1 and 2 until nothing new is added. 

The Hilbert basis theorem guarantees that the algorithm eventually stops. 
Unfortunately, there are redundant polynomials in this Grébner basis. 


Definition 11. A Gröbner basis G = {g;, g2,... gs} is minimal if for all 1 <i 
<s, LT (g;) ¢ (LT (g1), LT (g2),..., LT (gs)). 


Definition 12. A minimal Gröbner basis G = {g1, g9,...g,} is reduced if for 


all pairs i, j, i # j, no term of g ; is divisible by Į 7 ( gi) 


Theorem 4. Every polynomial ideal I C K[x] has a unique reduced Grdbner 
basis. 

A Grobner basis for a polynomial ideal may be computed using the Python 
command groebner. 


Example 6. 
Determine the critical points of the system 


LSH by He... Heder - Dy tx sory fy: (10.6) 


Solution. The critical points are found by solving the equations x = y = Q. 


Suppose that 


T= (x+y? —2x°,4x° — 12xy* + x* + 2x*y* + y*), 


then a reduced Gröbner basis for I with respect to >)},, may be computed using 
Python. The command lines are given in Section 10.5. Note that a different 


reduced Grobner basis might result if a different ordering is taken. 
{-195y4 + 1278y° — 1037y® + 90y! + y!?, 5970075x + 5970075 y" 
+163845838y" — 162599547y° + 14472880y* + 160356y!"} 
The first generator is expressed in terms of y alone, which can be determined 


from any one-variable technique. Back substitution is then used to determine the 
corresponding x values. There are seven critical points at 


(0, 0), (2.245, —3.011), (2.245, 3.011), (1.370, — 1.097), 
(1.370, 1.097), (—0.895, —0.422), (—0.895, 0.422). 


Of course, the reader could also use the solve command in Python which is based 
on the Buchberger algorithm. 


Example 7. 
The first five Lyapunov quantities for the Liénard system 


x=y-ayx- a — Os =a: y=-x- bx be. 
are 
L(0) = -a;; 
L(1) = —3a; + 2ba9; 
L(2) = 5b,(2a4 - b3a9); 


L(3) = -5b:(92b2a4 = 99b2a7 + 1520a5a4 = 760a3b3 — 46b2b3a7 F 198b3a4); 

L(A) = —b(14546b4a, + 105639a3b2 + 96664a3b2b3 — 193328a2b2a4 - 
891034aža4 + 445517a3b; + 211632aa? — 317094a2bza4 — 44190b2b3a5 + 
2209Sb2b2ay — 7273b4bya7 + 5319b3ay — 10638b2a1), 


where q, = =a) b, was substituted from L(1) = 0. The polynomials can be 


reduced using a number of substitutions; however, the Grébner basis is easily 
computed as: 


GB = {—4h2a4 F 3b3a3, —3a3 + 2bod, ay \ ; 


under the ordering a 4, a > >a3>a,4>b,>b3. The Grobner basis can then 


be used to help show that the origin is a center when all of the Lyapunov 
quantities are zero. The Python program for computing the Grébner basis is 
listed in Section 10.5. 


Note that there are specialist commutative algebraic packages, such as Singular 
and Macaulay, that use Grobner bases intensely for really tough problems. 


10.3 Melnikov Integrals and Bifurcating Limit Cycles 
from a Center 
Consider perturbed two-dimensional differential systems of the form 
X = f(x) + eg(x, €, 4). (10.7) 
Assume that the unperturbed system 
x = f(x) (10.8) 
has a one-parameter family of periodic orbits given by 
Pik H=7At), 


where the functions y ,(t) have minimum periods T , and r belongs to an 
indexing set, say, J, that is either a finite or semi-infinite open interval of ‘K. 


Definition 13. 
The Melnikov function for system (10.7) along the cycle" ,:x=y ,(t),0<t<T,, 


of (10.8) is given by 


T, f 
M(r, u) = Í exp(- iA VU) £ A g(y-(t), 0, dt. 
0 


0 


Theorem 5. 
Suppose that 


OM 


r 


M (ro, Ho) =0 and Æ 0, 


(rouo) 


where r ọ € I. Then for 0 < € < 1, system ( 10.7 ) has a unique hyperbolic limit 
cycle close to I’. . System ( 10.7 ) has no limit cycle close to T`, if M(r o, H o) # 


0 and e is small. 


Theorem 6. 

Suppose that M(r, u 9) = 0 has exactly k solutions r 4,f ,...,7 g E I with 
OM 
pacha + 0, 
ðr (riHo) 


for some i from 1 to k. Then for 0 < € < 1, exactly k one-parameter families of 
hyperbolic limit cycles bifurcate from the period annulus of ( 10.8 ) at the points 
Ft.. r g. If M(r, Ho) # 0, then there are no limit cycles. 


Melnikov-type integrals have been widely used since Poincaré’s investigations 
at the end of the 19th century. It is well known that the Melnikov function for 
system (10.7) is proportional to the derivative of the Poincaré map for (10.7) 
with respect to £. The interested reader may consult [2] for more details; the 
paper also deals with limit cycles of multiplicity greater than one and the 
bifurcation of limit cycles from separatrix cycles. To avoid elliptic integrals , 
only systems with y ,(t) = (x(t), y(t)) = (rcost, rsint) will be considered in this 


book. 


Example 8. 
Consider the van der Pol system 


gay, po-x-e(1—-xy. 


Prove that there is a limit cycle asymptotic to the circle of radius two when € is 
small. 


Solution. In this case, f(x) = (y, -x)’, T , = 27, g(x, £) = (0, -ey(1 - x2)),x= 
rcos(t), y = rsin(t) and V. f(x) = 0. Therefore, 


T, 
M(r, u) = Í f A g(y,-(t), 0, u) dt. 


O 


Thus 


M(r, u) = f 7? (sin? t(1 — r? cos? 1)) dt 


0 


and 
M(r, 11) = arr — 4). 


=0 wh =2 ôM = nro(r? — . Theref 
Hence M(r o, 4) = 0 when r 9 = 2 and = PEP = mro(r> — 2) # 0- Therefore, 


there exists a unique hyperbolic limit cycle asymptotic to a circle of radius two 
for the van der Pol system when € is sufficiently small. 


Example 9. 
Consider the Liénard system 


* = —y + ela x + a3x° + asx), ya x (10.9) 


Determine the maximum number and approximate location of the limit cycles 
when € is sufficiently small. 


Solution. Again, f(x) = (-y, x)’, T= 2m, g(x, €) = (e(a,x+a3x°+a5x°), 
0)! and V. f(x) = 0. Therefore, 


2r 
9 9 
M(r, u) = Í —ayr cos? t — aar" cos t — asr° cos t dt 
0 


and 
3a3 5ds 
M(r, 1) = =ni | a, +—r' + —r 
4 8 
The polynomial m(r) = a, + 343.2 , 3454 has at most two positive roots. 
4 8 


Therefore, when € is sufficiently small, system (10.9) has at most two hyperbolic 
limit cycles asymptotic to circles of radii r ; j=1,2), where r ; are the positive 


roots of m(r). 


10.4 Bifurcations Involving Homoclinic Loops 


Global bifurcations of limit cycles from centers were investigated in the previous 
section. Consider the following van der Pol type system 


zg=y+10x0.1-y), p=-x+C, 


(10.10) 

where C is a constant. If C = 0, the system has one critical point at the origin and 

a stable limit cycle surrounding it. However, if C ~ 0, there is a second critical 

point at ( i ( i j } which is a saddle point. Figure 10.2 shows 
+ 


TOC nc) + 9.1 


three possible phase portraits for varying values of the parameter C. 
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Figure 10.2 [Python animation] Typical phase portraits for system (10.10) when (a) C < —0. 18 (no limit 
cycle), (b) — 0.18 < C < 0. 18 (a stable limit cycle), and (c) C > 0. 18 (no limit cycle). 


When C is large and negative, the saddle point is far from the origin. As C is 
increased, and approaches the approximate value C ~ —0. 18, one of the stable 
and one of the unstable branches of the saddle point coalesce to form a 
homoclinic loop . As C is increased further towards C = 0, the saddle point 
moves away from the limit cycle (down the negative y axis). As C is increased 
through C = 0, the saddle point moves towards the limit cycle (down the positive 
y axis) and once more a homoclinic loop is formed at C ~ 0. 18. As C passes 
through C * 0. 18, the limit cycle vanishes. 

Homoclinic Bifurcation. The global bifurcation of limit cycles from 
homoclinic loops will now be discussed via example. The analysis involved in 
bifurcating limit cycles from separatrix cycles is beyond the scope of this book; 
however, interested readers are referred to [2]. Both homoclinic and heteroclinic 
bifurcations are used to obtain polynomial systems with a number of limit 


cycles; see Chapter 11 Python can be used to investigate some of these systems 
numerically. 


Example 10. 
Investigate the system 


Ly, pextx—xyt+ay 
as the parameter A varies and plot possible phase portraits. 


Solution. There are two critical points at O = (0, 0) and P = (-1, 0). The 
Jacobian is given by 


0 i 


ete = ara 


The origin is a saddle point, and it can be shown that the point P is a node or 


focus. Since trace J p = 1 + A, it follows that P is stable if A < —1 and unstable if A 


> —-1. The point P is also stable if A = -1. 


It can be shown that a limit cycle exists for — 1 <A <A 9, where A 9 = —0. 85. 


Since the limit cycle appears from a homoclinic loop, which exists at a value, 
say A ọ, this is known as a homoclinic bifurcation. More details can be found in 
[2]. Phase portraits for three values of A are shown in Figure 10.3 and a Python 
program showing an animation is listed in the next section. 
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Figure 10.3 [Python animation] Phase portraits for Example 10 when (a) A = —1. 5, (b) A = —0. 9, and (c) A 
=0. 


Another example is given in the exercises in Section 10.6. 


10.5 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


append =| # Append an object to the end of a list. 
reduced  |# Reduced Groebner basis. 


# Program 10a: Computing Lyapunov quantities for th 
e Lienard system. 


# Compute L(1) and L(2). 

from sympy import symbols, solve 

a2, a3, a4, a5 = symbols(’a2 a3 a4 a5’) 

b2, b3, b4, b5 = symbols(’b2 b3 b4 b5’) 

V30, V21, V12, V0O3 = symbols(’V30 V21 V12 V03’) 


V3 = solve([3*V30-2*V12-b2, V12, V21+a2, 2*V21- 
3*V03], 

[V30, V21, V12, V03]) 

print(V3) 


V40,V31,V22,V13,V04,eta4 = symbols(’V40 V31 V22 V13 
V04 eta4’) 


V4=solve([4*V40-2*V22-b3+2*a2**2, 2*V22-4*V04, - 
eta4-V31-a3, V22,\ 
-2* eta4+3*V31-3*V13+2*a2*b2, -eta4+V13],\ 
[V40, V31, V22, V13, V04, eta4]) 
print(V4) 


# Set a3=-2*a2*b2/3. 


V50, V41, V32,V23,V14,V05 = symbols(’V50 V41 V32 V23 
V14 V05’) 


V5=solve([5*V50-2*V32-b4+10*a2**2*b2/3, 3*V32- 
A*v14, V14,\ 
-V41-a4+2*a2**3,4*V41- 
3*V23+2*a2*b3, 2*V23-5*VO5], \ 
[V50, V41,V32, V23, V14,V05]) 
print(V5) 


V60,V51,V42,V33,V24,V15,V06,eta6 = symbols(’V60 V51 
V42 V33 
V24 V15 V06 eta6’ ) 
V6=solve([6*V60-2*V42-b5+6*a2*a4+4*a2**2*b2**2/3- 
B*a2*t 4. 
4*V42-4*V24-16*a2**4/3- 
4*a2**2*b3/3+8*a2*a4/3,\ 
V24-6*V06, \ 
V42+V24,\ 
-eta6-V51-a5+8*a2**3*b2/3,\ 
-3*eta6+5*V51-3*V334+2*a2*b4-8*a2**3*b2- 
2*a2*b2*b3+4*a4*b2,\ 
-3*eta6+3*V33-5*V15-16*a2**3*b2/3- 
4*a2*b2*b3/3+8*a4*b2/3,\ 
-eta6+V15],\ 
[v60, V51, V42, V33, V24, V15, VO6, eta6] 


print(V6) 


# Program 10b: Division algorithm for multivariate 
polynomials. 

# See Example 4. 

from sympy import reduced 

from sympy.abc import x,y,z 

f = x**4 + y**4 + Z**xĄ 

p=reduced(f,[x**2 + y ,z**2 y - 1, y - 2*2]) 

print(p) 

q=reduced(f, [y - z**2, z**2 y - 1, x*2 + y]) 

print(q) 


# Program 10c: The S-Polynomial. See Example 5. 
from sympy import expand, LM, LT, lcm 


from sympy.abc import x, y, Z 
def s_polynomial(f, g): 
return expand(lcm(LM(f), LM(g))* 
(1/LT(f)*f - 1/LT(g)*g)) 
f, g = [x - 13*y**2 - 12*z**3, x**2 - x*y + 92*Zz] 
s=s_polynomial(f, g) 
print(s) 


# Program 10d: Computing a Groebner basis. See Exam 
ple 6. 

# Groebner 

from sympy import groebner 

from sympy.abc import x,y 

G=groebner ([xt+y**2-x**3, 4*x**3- 
12*x*y**2+x**4+2*x**2*y**2+y**4], 

order=’ lex’ ) 

print(G) 


# Program 10e: Computing Groebner bases. See Exampl 
e 7. 

# Reducing the first five Lyapunov quantities of a 
Lienard system. 

from sympy import groebner, symbols 

al, a2, a3, a4, b2, b3 = symbols(’al a2 a3 a4 b2 b3 
") 

g=groebner([-al, 2*a2*b2-3*a3,5*b2*(2*a4-b3*a2),\ 

-5*b2* 
(92*b2**2*a4 - 99*b3**2*a2 + 1520*a2**2*a4 - 760*a2**3 
*b3 - \ 

46*b2**2*b3*a2 +198*b3*a4),\ 

-b2* 
(14546*b2**4*a4 + 105639*a2**3*b3**2 + 96664*a2**3*b2* 
*2*b3 -\ 

193328*a2**2*b2**2*a4 - 891034*a2**4*a4 + 445517*a2 
**5*b3 + \ 

211632*a2*a4**2 - 317094*a2**2*b3*a4 - 44190*b2**2* 
b3*a4 + \ 

22095*b2**2*b3**2*a2 -7273*b2**4*b3*a2 + 5319*b3**3 


*a2 - \ 
10638*b3**2*a4)], order=’lex’ ) 


print(g) 


GroebnerBasis([ai1, 2*a2*b2-3*a3, 3*a3*b3- 
4*a4*b2],a1,a2,a3,a4,b2,b3, 
domain=’ZZ’,order='lex’ ) 


# Programs 10f: Homoclinic Bifurcation. See Figure 
10.2. 

from matplotlib import pyplot as plt 

from matplotlib.animation import ArtistAnimation 

import numpy as np 

from scipy.integrate import odeint 


fig = plt.figure() 
plt.title(’Homoclinic Bifurcation’) 
plt.axis([-1.5, 1.5, -1.5, 1.5]) 


def homoclinici(x, t): 
return [x[1] + 10 x[0] (0.1 - x[1]**2), - 
x[O] + C] 


time = np.arange(0, 200, 0.01) 

x0O=[1, 0] 

myimages=[ ] 

for C in np.arange(-0.2, 0.2, 0.01): 
xs = odeint(homoclinici, x0, time) 
imgplot = plt.plot(xs[:, 0], xs[:, 1], "r-") 
myimages.append(imgplot ) 


my_anim = ArtistAnimation(fig, myimages, interval = 
100, blit=False, 
repeat_delay=100) 
plt.show() 


# Programs 10g: Homoclinic Bifurcation. See Figure 
10.3. 
from matplotlib import pyplot as plt 


from matplotlib.animation import ArtistAnimation 
import numpy as np 
from scipy.integrate import odeint 


fig = plt.figure() 
plt.title(’Homoclinic Bifurcation’) 
plt.axis([-2, 0.5, -1, 1]) 


def homoclinic2(x, t): 
return [x[1], x[0] + x[0]**2 - x[0] x[1] +L 
x[1]] 


time = np.arange(0, 50, 0.005) 

xO=[-0.1, 0.1] 

myimages=[] 

for L in np.arange(-2, -0.5, 0.01): 
xs = odeint(homoclinic2, x0, time) 
imgplot2 = plt.plot(xs[:, 0], xs[:, 1], "r-") 
myimages.append(imgplot2) 


my_anim = ArtistAnimation(fig, myimages, interval = 
100, blit = False, 
repeat_delay=100) 
plt.show() 


10.6 Exercises 


1. 
Prove that the origin of the system 
l so ca) 
SIANCO: JEFA) 
is a center using the transformation u * = G(x) and the classical symmetry 
argument. 
2. 


Fix a lexicographical order x > y > z. Divide the multivariate polynomial p 


=x 3 + y 3 + z 3 by the ordered list of polynomials | x+3y,xy2-x, YS 


2 


z 


. Repeat the division with the divisors listed as —~xx+3y, YS z}. 


(xy 
" Use Python to compute a Grébner basis for the set of polynomials 
h? -xxyy x?) 


under lexicographical, degree lexicographical, and degree reverse 
lexicographical ordering, respectively. Solve the simultaneous equations, y ? 


-~x3+x=0,y?-x?=0, forx andy. 


Write a program to compute the first seven Lyapunov quantities of the 
Liénard system 


k= y—(qqyxtanx’ +...¢ayx), y= x. (10.11) 


Prove that at most six small-amplitude limit cycles can be bifurcated 
from the origin of system (10.11). 


Consider the system 


a) 


K=y—(QX+ ag +... + dopsix z V=, 


Prove by induction that at most n small-amplitude limit cycles can be 
bifurcated from the origin. 


Write a program to compute the first five Lyapunov quantities for the 
Liénard system 


ž=y-(ax+ax +... +a7x), ý= -(x+ bx + bax +... + b6x°). 
Prove that Ĥ(4,2) = 2, ĤÂ(7,2) = 4, and Ĥ(3,6) = 4- Note that in 


Ĥ (u, v)» u is the degree of F and v is the degree of g. 


Consider the generalized mixed Rayleigh-Liénard oscillator equations given 
by 


. 3 2 4 3 
X=y, ý= -x -ay - bx — boxy — bax y- boy. 


Prove that at most three small-amplitude limit cycles can be bifurcated from 


10 


the origin. 
Plot a phase portrait for the system 
X=y, ý=x+ a 


Determine an equation for the curve on which the homoclinic loop lies. 
Consider the Liénard system given by 


3 3 ‘ 
xX=y-—e(ayx+t+ a + aax), ý= x. 


Prove that for sufficiently small e, there is at most one limit cycle that is 
asymptotic to a circle of radius 


Using Python, investigate the system 
*žx=y, ľ = x — X? + e€(Ay+ x’y) 


when € = 0. 1 for values of A from — 1 to — 0.5. How many limit cycles are 
there at most? 
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11. The Second Part of Hilbert’s Sixteenth 
Problem 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To describe the second part of Hilbert’s sixteenth problem. 

e To review the main results on the number of limit cycles of planar polynomial 
systems. 

e To consider the flow at infinity after Poincaré compactification. 

e To review the main results on the number of limit cycles of Liénard systems. 

e To prove two theorems concerning limit cycles of certain Liénard systems. 


On completion of this chapter, the reader should be able to 


e state the second part of Hilbert’s sixteenth problem; 

e describe the main results for this problem; 

e compactify the plane and construct a global phase portrait which shows the 
behavior at infinity for some simple systems; 

e compare local and global results; 

e prove that certain systems have a unique limit cycle; 

e prove that a limit cycle has a certain shape for a large parameter value. 


The second part of Hilbert’s sixteenth problem is stated and the main results 
are listed. To understand these results, it is necessary to introduce Poincaré 
compactification, where the plane is mapped onto a sphere and the behavior on 
the equator of the sphere represents the behavior at infinity for planar systems. 

Many autonomous systems of two-dimensional differential equations can be 
transformed to systems of Liénard type. In recent years, there have been many 
results published associated with Liénard systems. The major results for both 
global and local bifurcations of limit cycles for these systems are listed. 

A method for proving the existence, uniqueness, and hyperbolicity of a limit 
cycle is illustrated in this chapter, and the Poincaré-Bendixson theorem is 
applied to determine the shape of a limit cycle when a parameter is large. 


11.1 Statement of Problem and Main Results 


Poincaré began investigating isolated periodic cycles of planar polynomial 
vector fields in the 1880s. However, the general problem of determining the 
maximum number and relative configurations of limit cycles in the plane has 
remained unresolved for over a century. Recall that limit cycles in the plane can 
correspond to steady-state behavior for a physical system (see Chapter 7), so it is 
important to know how many possible steady states are there. 

In 1900, David Hilbert presented a list of 23 problems to the International 
Congress of Mathematicians in Paris. Most of the problems have been solved, 
either completely or partially. However, the second part of the sixteenth problem 
remains unsolved. Il’yashenko [16] presents a centennial history of Hilbert’s 
16th problem, Jibin Li [19] has written a review article of the major results up to 
2003, and more recently Han Maoan and Jibin Li [22] present some new lower 
bounds associated with the problem. 

The Second Part of Hilbert’s Sixteenth Problem. Consider planar 
polynomial systems of the form 


X = P(x, y), y = Q(x, y), 


11.1 
a P a Q are polynomials in x and y. The question is to estimate the 
maximal number and relative positions of the limit cycles of system (11.1). Let 
H „ denote the maximum possible number of limit cycles that system (16.1) can 
have when P and Q are of degree n. More formally, the Hilbert numbers H „ are 
given by 
H, = sup{z(P, Q) : 0P,0Q < n}, 


where 0 denotes “the degree of” and m(P, Q) is the number of limit cycles of 
system (11.1). 

Dulac’s Theorem states that a given polynomial system cannot have 
infinitely many limit cycles. This theorem has only recently been proved 
independently by Ecalle et al. [14] and Il’yashenko [17], respectively. 
Unfortunately, this does not imply that the Hilbert numbers are finite. 

Of the many attempts to make progress in this question, one of the more 
fruitful approaches has been to create vector fields with as many isolated 
periodic orbits as possible using both local and global bifurcations . There are 
relatively few results in the case of general polynomial systems even when 


considering local bifurcations. Bautin [1] proved that no more than three small- 
amplitude limit cycles could bifurcate from a critical point for a quadratic 
system. For a homogeneous cubic system (no quadratic terms), Sibirskii [29] 
proved that no more than five small-amplitude limit cycles could be bifurcated 
from one critical point. Zoladek [33] recently found an example where 11 limit 
cycles could be bifurcated from the origin of a cubic system, but he was unable 
to prove that this was the maximum possible number. 

Although easily stated, Hilbert’s sixteenth problem remains almost 
completely unsolved. For quadratic systems, Shi Songling [28] has obtained a 
lower bound for the Hilbert number H , = 4. A possible global phase portrait 


showing the configuration of the limit cycles is given in Figure 11.1. The line at 
infinity is included and the properties on this line are determined using Poincaré 
compactification, which is described in Section 11.2. There are three small- 
amplitude limit cycles around the origin and at least one other surrounding 
another critical point. Some of the parameters used in this example are very 
small. 

Blows and Rousseau [2] consider the bifurcation at infinity for polynomial 
vector fields and give examples of cubic systems having the following 
configurations: 


(4), 1}, (3), 24, (2), 5}, (4), 2}, (CD, 5} and {(2), 44, 


where {(/), L} denotes the configuration of a vector field with | small-amplitude 
limit cycles bifurcated from a point in the plane and L large-amplitude limit 
cycles simultaneously bifurcated from infinity. There are many other 
configurations possible, some involving other critical points in the finite part of 
the plane as shown in Figure 11.2. Recall that a limit cycle must contain at least 
one critical point. 


Limit EO G 


~ Small-amplitude 
f © limit cycles 


Figure 11.1 A possible configuration for a quadratic system with four limit cycles: one of large amplitude 
and three of small amplitude. 


By considering cubic polynomial vector fields, in 1985, Li Jibin and Li Chunfu 
[20] produced an example with 11 limit cycles by bifurcating limit cycles out of 
homoclinic and heteroclinic orbits ; see Figure 11.2. Yu Pei and Han Maoan [26] 
bifurcated 12 small-amplitude limit cycles (two nests of six) from a cubic system 
with one saddle point at the origin and two focus points symmetric about the 
origin. In 2009, Chengzhi Li et al. proved that H 3 = 13, having found a cubic 


system with 13 limit cycles [5]. 
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Figure 11.2 A possible configuration for a cubic system with 11 limit cycles. 


Returning to the general problem, in 1995, Christopher and Lloyd [9] 
considered the rate of growth of H „as n increases. They showed that H „ grows 
at least as rapidly as n *logn. Other rates of growth of H „ with n are presented in 
[19] and [22]. 

In recent years, the focus of research in this area has been directed at a small 
number of classes of systems. Perhaps the most fruitful has been the Liénard 
system. 


11.2 Poincaré Compactification 


The method of compactification was introduced by Henri Poincaré at the end of 
the 19th century. By making a simple transformation, it is possible to map the 
phase plane onto a sphere. Note that the plane can be mapped to both the upper 
and lower hemispheres. In this way, the points at infinity are transformed to the 
points on the equator of the sphere. Suppose that a point (x, y) in the plane is 
mapped to a point (X, Y, Z) on the upper hemisphere of a sphere, say, 
S? = {(X, Y, Z) € R? : X2 + Y? + Z? = 1}. (Note that it is also possible to map 
onto the lower hemisphere). The equations defining (X, Y, Z) in terms of (x, y) 
are given by 

Ya n an aa E l 
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where r? =x? + y. A central projection is illustrated in Figure 11.3. 


Figure 11.3 A mapping of (x, y) in the plane onto (X, Y, Z) on the upper part of the sphere. 


Consider the autonomous system (11.1). Convert to polar coordinates . Thus 
system (11.1) transforms to 

r= r n+1(8) + m n-1(0) Wess Y fi®) 

0 = r'en) + a 9,16 Fet r-!g\(0), 


(11.2) 
where f m and g m are polynomials of degree m in cos@ and siné. 


Let p = 1. Hence o = —4, and system (11.2) becomes 


È = -Pfa O+ OP, È= Bn+i(O) + Op). 


Theorem 1. 
The critical points at infinity are found by solving the equations bp=ġ=00np 


= 0, which is equivalent to solving 

8n+1(0) = cos 0Q,(cos 0, sin A) — sin 0P,„(cos 0, sin 0) = 0, 
where P „and Q „are homogeneous polynomials of degree n. Note that the 
solutions are given by the pairs 8 ; and 0 ; + n. As long as g ,,.;(@) is nonzero, 


there are n + 1 pairs of roots and the flow is clockwise when g „+‚(0) < 0 and it 
is counterclockwise when g ,,.;(8) > 0. 


To determine the flow near the critical points at infinity, one must project the 
hemisphere with X > 0 onto the plane X = 1 with axes y and z or project the 
hemisphere with Y > 0 onto the plane Y = 1 with axes x and z. The projection of 
the sphere S ° onto these planes is depicted in Figure 11.4. 


Figure 11.4 The projections used to determine the behavior at infinity. 


If n is odd, the antinodal points on S ° are qualitatively equivalent. If n is 
even, the antinodal points are qualitatively equivalent but the direction of the 
flow is reversed. 

The flow near a critical point at infinity can be determined using the 
following theorem. 


Theorem 2. 
The flow defined on the yz plane (X = +1), except the points (0, +1, 0), is 
qualitatively equivalent to the flow defined by 


where the direction of the flow is determined from g ,,(8). 


In a similar way, the flow defined on the xz plane (Y = +1), except the points 
(+1, 0, 0), is qualitatively equivalent to the flow defined by 


+% = xz" (ž, 1) = zP (z, 1) is z+! (z, 1), 


where the direction of the flow is determined from g „+1(0). 


Example 1. Construct global phase portraits, including the flow at infinity, for 
the following linear systems: (a) x = —x + 2y, ý = 2x + 2y; (b) 


X=xX+y),y=-X+y). 
Solutions. (a) The origin is a saddle point with eigenvalues and corresponding 


eigenvectors given by A , = 3, (1, 2)’ and À , = —2, (2, -1)". The critical points at 
infinity satisfy the equation g 5(@) = 0, where 


22(0) = cos AQ, (cos 0, sin 8) — sin OP (cos Ø, sin 8). 
Now 


g2(0) = 2 cos’ 8 + 3.cos sin 6 — 2 sin? 0. 


The roots are given by 0 , = tan 1(2) radians, 0 , = tan” !(2) + m radians, 
63 = tan”! (—4) radians, and 4, = tan`! (—4) + x radians. 


A plot of g (0) is given in Figure 11.5. 


Figure 11.5 The function g 2(0). 


The flow near a critical point at infinity is qualitatively equivalent to the flow 
of the system 


. 2y 3 2y . 2y 
+ý =yz(-4 + 2)-2(2-2), sż=z2(-1+2). 


< £ 


From Figure 11.5, the flow is counterclockwise if tan-!(-3) <6 < tan7!(2) 


. Therefore the flow at infinity is determined by the system 
-ý = -3y + 2y? - 2, —ż = -z + 2yz. 
There are critical points at A = (2,0) and B = (—1,() in the yz plane. Point 


A is a stable node and point B is an unstable node. A phase portrait is given in 
Figure 11.6. 
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Figure 11.6 Some trajectories in the yz plane (X=1) that define the flow at infinity. 


Since n is odd, the antinodal points are qualitatively equivalent. A global 
phase portrait is shown in Figure 11.7. 


Figure 11.7 A global phase portrait for Example 1(a). 


(b) The origin is an unstable focus and the flow is clockwise. The critical 
points at infinity satisfy the equation g 5(@) = 0, where 


22(9) = cos 6Q,(cos 0, sin 0) — sin 0P; (cos 0, sin 6) = ~(cos” 6 + sin’ 0). 


There are no roots for g (0), so there are no critical points at infinity. A 
global phase portrait is given in Figure 11.8. 


Figure 11.8 A global phase portrait for Example 1(b). There are no critical points at infinity and the flow 
is clockwise. 


Example 2. 
Show that the system given by 


has at least two limit cycles. 


Solution. There are two critical points at O = (0, 0) and A = (0, 1). The Jacobian 
matrix is given by 


J=- -1 -2x+y -l +x+2y 
A 14+2x-3y -3x l 


Now 


= _] l ] 
Jo =( i 0 | and ER ) 
Therefore, O is a stable focus and A is an unstable focus. On the line L 4: 1 + 
x- 3y=0, ý =O and x < 0, so the flow is transverse to L 4. 
The critical points at infinity satisfy the equation g (8) = 0, where 
23(@) = cos 8Q>(cos 0, sin 8) — sin @P>(cos Ø, sin 8). 
Now 
23(0) = cos? 8 — 2 cos” Osin 0 — cos @ sin? 6 — sin’ 0. 


A plot for g 3(8) is given in Figure 11.9. 
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Figure 11.9 The function g 3(6). 


There are two roots for g 3(@): 8 4 = 0. 37415 radians and @ 5 = 3. 51574 


radians. The flow near a critical point at infinity is qualitatively equivalent to the 
flow of the system 


= -¥-yzt+2yty+y?-z-1 
= 2 2 
an ae ee oe ec 


H+ 


X 


H 
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There is one critical point at (y, z) = (0. 39265, 0), which is a saddle point. Since 
n is even, the antinodal point is also a saddle point, but the direction of the flow 
is reversed. The direction of the flow may be established by inspecting g 3(@) in 
Figure 11.9. 

Part of the global phase portrait is shown in Figure 11.10, and from the 
corollary to the Poincaré-Bendixson Theorem , there are at least two limit cycles. 


Figure 11.10 A global phase portrait showing at least two limit cycles. UF and SF denote an unstable and 
stable focus, respectively. 


If the system is nonlinear and there are no critical points at infinity, it is also 
possible to bifurcate limit cycles from infinity; see, for example, the work of 
Blows and Rousseau [2]. 

Guillaume Cantin has produced web pages with some Python code for 
dynamical systems [4] and one of his examples demonstrates a saddle-node 
bifurcation at infinity. 

Marasco and Tenneriello [24] use Mathematica to propose methods that give 
the Fourier series of the periodic solutions and period of planar systems in the 
presence of isochronous centers and unstable limit cycles. 


11.3 Global Results for Liénard Systems 


Consider polynomial Liénard equations of the form 
X+ f(x)x + g(x) = 0, (11.3) 


where f(x) is known as the damping coefficient and g(x) is called the 
restoring coefficient . Equation (11.3) corresponds to the class of systems 


x= y, y = —g(x) — fN., 


(11.4) 
in the phase plane. Liénard applied the change of variable Y = y + F(x), 


where F(x) = f 9 * f(s)ds, to obtain an equivalent system in the so-called Liénard 
plane : 


K=Y-F(x), Y= -p(x). 


(11.5) 

For the critical point at the origin to be a nondegenerate focus or center, the 
conditions g(0) = 0 and g'(0) > 0 are imposed. Periodic solutions of (11.5) 
correspond to limit cycles of (11.2) and (11.5). There are many examples in both 
the natural sciences and technology where these and related systems are applied. 
The differential equation is often used to model either mechanical systems or 
electric circuits, and in the literature, many systems are transformed to Liénard 
type to aid in the investigations. For a list of applications to the real world, see, 
for example, Moreira [25]. In recent years, the number of results for this class of 
system has been phenomenal, and the allocation of this topic to a whole section 
of the book is well justified. 

These systems have proved very useful in the investigation of multiple limit 
cycles and also when proving existence, uniqueness, and hyperbolicity of a limit 
cycle. Let 0 denote the degree of a polynomial, and let H(i, j) denote the 
maximum number of global limit cycles, where i is the degree of f and j is the 
degree of g. The main global results for systems (11.2) and (11.5) to date are 
listed below: 


e In 1928, Liénard proved that when og = 1 and F is a continuous odd function, 
which has a unique root at x = a and is monotone increasing for x > a, then 
(11.5) has a unique limit cycle. 

e In 1973, Rychkov [27] proved that if dg = 1 and F is an odd polynomial of 
degree five, then (11.5) has at most two limit cycles. 

e In 1976, Cherkas [6] gave conditions in order for a Liénard equation to have a 
center. 

e In 1977, Lins, de Melo, and Pugh [21] proved that H(2, 1) = 1. They also 
conjectured that H(2m, 1) = H(2m + 1, 1) = m, where m is a natural number. 

e In 1988, Coppel [10] proved that H(1, 2) = 1. 

e In 1992, Zhang Zhifen [32] proved that a certain generalized Liénard system 
has a unique limit cycle. 

e In 1996, Dumortier and Chengzhi Li [11] proved that H(1, 3) = 1. 

e In 1997, Dumortier and Chengzhi Li [12] proved that H(2, 2) = 1. 

e In 2005, Jiang et al. [18] proved that when f and g are odd polynomials, H(5, 
3) = 2. 


e In 2007, Dumortier et al. [13] proved that the conjecture by Lins, de Melo, 
and Pugh from 1977 was incorrect. 

e In 2014, Xiong and Han [31] obtain some new lower bounds for the Hilbert 
numbers of certain Liénard systems. 

e In 2017, Sun and Huang [30] show that a Liénard system of type (4, 3) can 
have six limit cycles using an algorithm based on the Chebyshev criteria and 
the tools of regular chain theory in polynomial algebra. 


Giacomini and Neukirch [15] introduced a new method to investigate the limit 
cycles of Liénard systems when 0g = 1 and F(x) is an odd polynomial. They are 
able to give algebraic approximations to the limit cycles and obtain information 
on the number and bifurcation sets of the periodic solutions even when the 
parameters are not small. Other work has been carried out on the algebraicity of 
limit cycles, but it is beyond the scope of this book. 

Limit cycles were discussed in some detail in Chapter 5, and a method for 
proving the existence and uniqueness of a limit cycle was introduced. Another 
method for proving the existence, uniqueness, and hyperbolicity of a limit cycle 
is illustrated in Theorem 4. 

Consider the general polynomial system 


X= P(x,y), y= Oxy), 


where P and Q are polynomials in x and y, and define X = (P, Q) to be the 
vector field. Let a limit cycle, say, T(t) = (x(t), y(t), have period T. 


Definition 1. The quantity f p div(X) dt is known as the characteristic 
exponent . 


Theorem 3. 
Suppose that 


T 
Í div(X) dt = { tae (x(t), y(t) dt. 
r o \ôx dy 
Then 


(i) T is hyperbolic attracting if f p div(X) dt < 0; (ii) T is hyperbolic repelling if fp 
div(X) dt > 0. 


Theorem 4. 
Consider the Liénard system 


k=y-(axt ax tax), y= x. (11.6) 
There exists a unique hyperbolic limit cycle if a ; a 3 < 0. 


Proof. The method is taken from the paper of Lins, de Melo, and Pugh [21]. 
Note that the origin is the only critical point. The flow is horizontal on the line x 
= 0 and vertical on the curve y=a,x+a5x*+a3x°. Itis not difficult to 
prove that a trajectory starting on the positive (or negative) y-axis will meet the 
negative (or positive) y-axis. The solution may be divided into three stages: I 
Every limit cycle of system (11.6) must cross both of the lines given by 


II System (11.6) has at least one and at most two limit cycles; one of them is 
hyperbolic. 

III System (11.6) has a unique hyperbolic limit cycle. 

Stage I. Consider the Lyapunov function given by 


1 
V(x, y) = e” 2 b =k + 5 | 


a2 


. Now 


dV Se 
— = 2ae “P xX 


dt 


COES: Ta) 


The Lyapunov function is symmetric with respect to the y-axis since V (x, y) = V 
(—x, y), and there is a closed level curve V (x, y) = C that is tangent to both L 4 


and L 5. Since 2 does not change sign inside the disc V (x, y) = C, no limit 
G 


cycle can intersect the disk, which proves Stage I. 
Stage II. Suppose that there are two limit cycles y 4 C y surrounding the origin 


as in Figure 11.11. 


Figure 11.11 Two limit cycles crossing the lines L 4 and L 9. 


Suppose that a ; < 0 anda 3 > 0. Then the origin is unstable. Let y ; be the 
innermost periodic orbit, which must be attracting on the inside. Therefore, 


T div(X) dt = it (a F284 R TEA 
yı yı 


Let P ; and Q ; i = 0, 1, 2, 3, be the points of intersection of y ; and y >, 


respectively, with the lines L į and L 5. Now (i S Ape I dY dy = 0» and 


dt 


similarly for the periodic orbit y 5. 
Consider the branches P o P į andQ,) Q 4 ony į andy 5, respectively. The 


flow is never vertical on these branches. Hence one may parameterize the 
integrals by the variable x. Thus 


Xp + 3G 2 
l (ay + 303) dt = Í AE y 
PoP| XO Yyı (x) i F(x) 


“i (a; + 3a3x° 
i ~(a, + 30322) dt = T Iar 
Q001 x Yy (=F) 


In the region x ọ < x < x 4, the quantity — (a 4 + 3a 3 x °) > 0 and 
yy x) — F(x) > yp œ) — F(x) > 0. It follows that 


and 


Í -(a; + 3a3x") dt < Í -a +a dt. 
Qo?) PoP 


Using similar arguments, it is not difficult to show that 


Í ~(a, + 3a3x*) dt < { —(a, + 33x") dt. 
Q203 P2P3 


Consider the branches P 4 P and Q ; Q» on y į and y 5, respectively. The flow 


is never horizontal on these branches. Hence one may parameterize the integrals 
by the variable y. Thus 


w AB Da 
T (ay + 3a3x") dt = 1 AEE ACE 
Pi Pa y 


yı Xy] 


and 
a Y2 (a, + 3a ON 
f I N f (a1 + 34st) 
Q10 yı Xyz 


In the region y 1 <y <Y ņ Xy, (Y) > xy, @). It follows that 


Í -(aı + 3a3x°) dt < { (ait 3a3x") dt. 
Q1Q2 P,P) 


Using similar arguments, it is not difficult to show that 


| -(a; + 3a3x°) dt < Í (a, + 3a3x’) dt. 
Q300 P3 Po 


Thus adding all of the branches together, 


i) div(X) dt < Í div(X) dt < 0 


v2 YI 
which proves Stage II. 
Stage III. Since the origin is unstable and f div(X)dt < if div(X)dt < 0 
%2 yı 


, the limit cycle y 5 is hyperbolic stable and the limit cycle y į is semistable . By 
introducing a small perturbation such as x = y — F(x) — ex, it is possible to 


bifurcate a limit cycle from y , that lies between y 5 and y 4. Therefore, system 


(11.6) has at least three limit cycles, which contradicts the result at Stage II. 
Hence system (11.6) has a unique hyperbolic limit cycle. 

A Liénard System with a Large Parameter. Consider the parameterized 
cubic Liénard equation given by 


X + uf(x)x + g(x) = 0, 
where f(x) = -1 + 3x ? and g(x) = x, which becomes 
X= py—pF(x), py = —g(x), 
(11.7) 
where F(x) = f 9 * f(s)ds = -x + x 3, in the Liénard plane. Liénard (see 
Chapter 10) proved that system (11.7) has a unique limit cycle. Systems 
containing small parameters were considered in Chapter 10 using Melnikov 
integrals. 
The obvious question then is, what happens when p is large? Figure 11.12 


shows the limit cycle behavior in the Liénard and tx planes, when u = 20 for 
system (11.7).Let 4 = 1. Then system (11.7) can be written as an equivalent 


system in the form 
ex=y-— F(x), y= —eg(x). 


(11.8) 


Figure 11.12 (a) [Python Animation] A limit cycle for the cubic system when F(x) = -x + x 3, the 
function y = F(x) is also shown. (b) Periodic behavior in the tx plane. 


Theorem 5. Consider system ( 11.8 ) and the Jordan curve J shown in Figure 
11.13 . As u > œ or, alternatively, € > 0, the limit cycle tends towards the 
piecewise analytic Jordan curve J. 


Figure 11.13 The Jordan curve and the function y = F(x). 


Proof. 

The method of proof involves the Poincaré-Bendixson Theorem from Chapter 5. 
Thus everything is reduced to the construction of an annular region A that is 
positively invariant and that contains no critical points. The construction is 
shown in Figure 11.14. 


Figure 11.14 Construction of the inner and outer boundaries of the annular region that forms a positively 
invariant set in one half of the plane. A similar construction is used in the other half of the plane using 
symmetry arguments. 


Note that system (11.8) is symmetric about the y-axis, so we need only consider 
one half of the plane. 

First, consider the outer boundary. The arc 1-2 is a horizontal line, and 2-3 is 
a vertical line from the graph y = F(x) to the graph y = F(x) — h, where his a 
small constant. The arc 3-4 follows the y = F(x) — h curve, and the line 4-5 is a 
tangent. 

Now consider the inner boundary. The line 6-7 is sloped below the 
horizontal, and the line 7-8 is vertical and meets the curve y = F(x). The arc 8-9 
follows the curve y = F(x), and the line 9-10 is horizontal. 


To prove that the region is positively invariant, one must show that the 
marked arrows point in the directions indicated in Figure 11.14. Consider each 
arc separately. 

Notation. For any point n in Figure 11.14, let F’(n) and g(n) be the values of 
these functions at the abscissa of n. 

Arc 1-2. On this line, y < 0 since y = —x and x > 0. 


Arc 2-3. On this line, y < F(x), so ex = y — F(x) < 0. Note that ý < 0 at 


point 2. 
Arc 3-4. Suppose that p is a point on this arc. The slope of a trajectory 
crossing this arc is given by 


dy) _ -&g(p) _ €83) 
dalp —h h 
and 
dy 
dx|, í 


as € > 0. Therefore, for € small enough, 
dy 


dx 


< F'(4) < F'(p) 
p 
on the arc. Since x < 0 along the arc, trajectories cross the boundary inwards. 
Arc 4-5. Since | y — F(x) | > h, the slope of the curve 4-5 is 


dy) _ &8(4) 
dx\4 h Í 


which tends to zero as € > 0. Once more x < Q0 on this arc, for ¢ small enough, 


and the pointing is inward. 
Arc 6-7. Let d į be the vertical distance of the line 7-8. For d , small enough, 


along the line 6-7, | y — F(x) | > d ;. Thus the slope of the curve at a point q say, 
on the line 6-7 is given by 


dy 2 of 7 2 
dy| _ € 8M E a7) 
dx q dı di 


which tends to zero as € > 0. Since x > Q0 on this arc, for € small enough, the 


pointing will be as indicated in Figure 11.14. 
Arc 7-8. On this line, y - F(x) > 0, so x > 0. 


Arc 8-9. On the curve, y = F(x) with x > 0, ý < 0, and x = 0. 
Arc 9-10. On this line, y — F(x) < 0 and y < 0. 


Using similar arguments on the left-hand side of the y-axis, a positively 
invariant annulus can be constructed. Since system (11.8) has a unique critical 
point at the origin, the Poincaré-Bendixson theorem can be applied to prove that 
there is a limit cycle in the annular region A. For suitably small values of h and d 
, the annular region will be arbitrarily near the Jordan curve J. Therefore, if I (e) 


is the limit cycle, then T (e) > Jase > 0. 


11.4 Local Results for Liénard Systems 


Although the Liénard equation (11.5) appears simple enough, the known global 
results on the maximum number of limit cycles are scant. By contrast, if the 
analysis is restricted to local bifurcations, then many more results may be 
obtained. The method for bifurcating small-amplitude limit cycles is given in 
Chapter 10. Consider the Liénard system 


ž=y, y= -g(x)— fœ), 
(11.9) 
where f(x) =a) +a ,X+@yx72+...+a,,xX™and g(x) =x+b x2+b,x? 
+... +b x”; m andn are natural numbers. Let Ĥ(m, n) denote the maximum 
number of small-amplitude limit cycles that can be bifurcated from the origin for 


system (11.9), where m is the degree of f and n is the degree of g. 
In 1984, Blows and Lloyd [3] proved the following results for system (11.9): 


° If of =m = 2ior2i + 1, then Ĥ(m,1)= i- 


° If g is odd and of = m = 2i or 2i + 1, then (m,n) = i- 


In addition to the above the author has proved the following results by 
induction. 


e If dg =n= 2j or 2j + 1, then H(,n) = j 
e If fis even, of = 2i, then Ĥ(2i, n) = i- 
e If fis odd, of = 2i + 1 and og =n = 2j + 2 or 2j + 3; then (2; + 1,n) = i+ j 


e If Of=2, g(x) =x + g Q(x), where g , is even and ôg = 2j; then Ĥ(2,2 j) = j- 


Christopher and the author [7] have more recently developed a new algebraic 
method for determining the Lyapunov quantities , and this has allowed further 
computations. Let |. | denote the integer part. Then the new results are listed 
below: 


° H(2, n) Z |24]. 


° Âm, 2) = | #4]: 
° A(3,n)=2 |2), forall 1 <n < 50. 


° Him, 3) =2 | Sats |, for all 1 < m < 50. 
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degree of g 


Table 11.1 The values of H(m,n) for varying values of m and n. 


Complementing these results is the calculation of Ĥ(m, n) for specific values of 


m and n. The results are presented in Table 11.1. 
The ultimate aim is to establish a general formula for (m, n) as a function 


of the degrees of f and g. Christopher and Lloyd [8] have proven that Table 11.1 
is symmetric but only in the restricted cases where the linear coefficient in f(x) is 
nonzero. The author et al. [18] have recently started working on simultaneous 
bifurcations for symmetric Liénard systems, and Maoan and Romanovski [23] 
have used a new method to give more results. Future work will concentrate on 
attempting to complete Table 11.1 and determining a relationship, if any, 
between global and local results. 

It is important to note that programming with mathematical packages is a key 
tool that has to be used carefully. For example, it may be that two limit cycles 
bifurcating from a fine focus cannot be distinguished on a computer screen. 
There are always restrictions on how far a package can be used and this presents 
a good example of that fact. An example of a system with four limit cycles in 


close proximity is given in the Coursework examples in Chapter 22 


11.5 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


myimages=[ ] # Set up an empty vector. 
lplt.axes | # Set axes limits. 


# Program 11a: Animation of a limit cycle for a Lie 
nard system. 

# See Figure 11.12. 

from matplotlib import pyplot as plt 

from matplotlib.animation import ArtistAnimation 

import numpy as np 

from scipy.integrate import odeint 


fig = plt.figure() 
xmin, xmax = -1.5, 1.5 
ymin, ymax -5, 5 


ax = plt.axes(xlim=(xmin, xmax), ylim=(ymin, ymax) ) 


def Lienard(x, t): 
return [mu x[1] - mu (-x[0] + x[0]**3), - 
x[0]/mu] 


time = np.arange(0, 20, 0.1) 

x0=[1, 0] 

myimages=|[ ] 

for mu in np.arange(0, 5, 0.1): 
XS = Odeint(Lienard, x0, time) 
imgplot = plt.plot(xs[:, 0], xs[:, 1], "r-") 
myimages.append(imgplot ) 


my_anim = ArtistAnimation(fig, myimages, interval = 
100, \ 


blit = False, 


epeat_delay = 100) 


plt.show() 


11.6 Exercises 


1. 


Draw a global phase portrait for the linear system 
x=y, x=—4x—-5y 
including the flow at infinity. 


Draw a global phase portrait for the system 

c=] -3x + 4y, ý=-2x+ 3y 
and give the equations defining the flow near critical points at infinity. 
Determine a global phase portrait for the quadratic system given by 


ž=x +y -l, y=5xy-S. 


Draw a global phase portrait for the Liénard system 


k=y-x-x, ý = =), 


Draw a global phase portrait for the Liénard system 
k=y-x+x, ý = ay: 
Use Python to compare the limit cycles for Liénard systems in the phase 
plane and in the Liénard plane. Plot the periodic orbits in the xt plane. 
Use Python to investigate the system 
ž= y- (aıx + WK Far: ý= -=x 
for varying values of the parameters a 4, a 5, and a 3. 


Use Python to investigate the limit cycles, if they exist, of the system 


r 


K=y —e(ayxt ax t+... t+ ayx”, y= =X. 


as the parameter € varies from zero to infinity. 


9. 
Prove Liénard’s theorem that when og = 1 and F(x) is a continuous odd 
function that has a unique root at x = a and is monotone increasing for x = 
a, (11.5) has a unique limit cycle. 
10. 
This is quite a difficult question. Consider the Liénard system 
=y- F(x), y=-x, (11.10) 
where F(x) = (a 4 x +a 3x? +a » x ”) is odd. Prove that system (11.10) 
has at most two limit cycles. 
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Aims and Objectives 


To introduce the method of steps for Delay Differential Equations (DDEs). 
To investigate the stability of simple DDEs. 

To solve DDEs numerically using Python. 

To investigate applications in dynamical systems. 


On completion of this chapter, the reader should be able to 


e use the method of steps to solve simple DDEs; 

e determine the stability of simple DDEs; 

e apply the theory of DDEs to examples from biology, economics, 
environmental science, mechanical systems, neural networks, and nonlinear 
optics and interpret the numerical solutions physically. 


Almost all dynamical systems can be subject to some sort of feedback 
control, where a time delay arises due to a finite time interval being required for 
the system to sense a change and react to it. Also, many dynamical systems, 
especially in biology, have the delays inherently built in. Seeking solutions to 
these type of problems has led to the field of mathematics known as Delay 
Differential Equations , abbreviated to DDEs in most of the literature. 

There are a number of DDE solvers in Python including, for example, 
PyDDE authored by the University of Oxford, ddeint authored by Valentin 
Zulko, and pydelay licensed under the MIT License. Currently, these packages 
are not that user-friendly and it is hoped that a more robust solver will be 
developed in Python in the near future. 

The chapter begins with an introduction and an outline of the method of 
steps used to solve certain DDEs. The following sections highlight applications 


in biology, nonlinear optics, and other dynamical systems. 


12.1 Introduction and the Method of Steps 


Dynamical systems subject to some sort of delay have been studied for over two 
hundred years, and the paper of Schmitt [23] provides references and lists some 
properties of simple linear DDEs. DDEs were studied more extensively after the 
second world war with the need for control engineering in technology but it is 
only in the last few decades that DDEs have become extensively studied with the 
development of mathematics packages such as Python. An introduction to the 
theory of DDEs is given in [7], applications of DDEs are discussed in [8], DDEs 
applied to the life sciences are covered in [27], and a nice introduction to the 
dynamics of nonlinear time delay systems is provided in [17]. DDEs differ from 
ODEs in that the derivative any time depends on the solution at prior times. 
These systems are infinite-dimensional; it is necessary to provide a so-called 
initial history function to specify the value of the solution set before time t = 0, 
and the time delays could be constants or state-dependent. Recent developments 
in the field of DDEs are outlined in [16]. 


Definition 1. 
A DDE subject to constant time delays is of the form: 
dx 


a = f (x(t), X(t — T1), X(t — T>),..., X(t —T,)), (12.1) 


where x € R” and the delays T ; are positive constants. 
YS Tj p 


In order to solve DDEs it is necessary to define an initial history function which 
determines the behavior of the dynamical system x(t) defined on the interval 
[-t, 0], assuming that the systems start at t = 0. 

The simplest method for solving some systems of DDEs has been labeled as 
the method of steps . DDEs differ from ODEs in that the solution for the DDE 
can be thought of as a mapping from functions on an interval [t -t, t] onto 
functions on an interval [t, t + t]. In some very simple cases, it is possible to 
work out an analytical solution to this problem as the following example 
demonstrates. 


Example 1. 
Solve the simple linear DDE given by 


SE (12.2) 
— =-x(t- 1), . 
dt 

with initial history function x(t) = 1, on [-1, 0]. 


Solution. Suppose that x(t) = b ;_,(¢) on the interval [ż; — 1, t;]. Then, using 


separation of variables, on the interval [f;, t; + 1]: 


x(t) t 
Í ax = - f i-i (£ — 1)dr. 
p ti 


i-l 


and 
X(t) = P(t) = ġi-ı (ti) — { piat — 1)dt’. (12.3) 


Therefore, in the interval [0, 1], equation (12.3) gives 
Í 
x)= 1 -f ld =1-t 
0 


t 2 


t 1 3 
t =0-— LF = df =- |2t-—| =-2t+—> +5. 
x(t) Í ( ) | z| taa 


and in the interval [1, 2]: 


One could continue to calculate the solution on further intervals by hand but the 
process can be easily implemented in Python. The Python program for 
computing the analytical solution for — 1 < t < 10 is listed in Section 12.5 and the 
computed solutions on the further intervals are listed below: 


On [2,3], x(t)=-t**3/6+3*t**2/2-4*t+17/6. 


On [3,4], x(t)=t**4/24-2*t**3/3+15*t**2/4- 
17*t/2+149/24. 


On [4,5], x(t)=-t**5/120+5*t**4/24-2*t**3+109*t**2/12- 
115*t/6+1769/120. 


On [5,6], x(t)=t**6/720-t**5/20+35*t**4/48- 


197*t**3/36+1061* t**2/48 - 
1085*t/24+26239/720. 


On [6,7], x(t)=-t**7/5040+7*t**6/720- 
t**5/5+107*t**4/48-521*t**3/36+ 
13081*t**2/240-13201*t/120+463609/5040. 


On [7,8], x(t)=t**8/40320-t**7/630+7*t**6/160- 
487*t**5/720+3685*t**4/576 

-27227*t**3/720+39227*t**2/288- 
39371*t/144 +3157891/13440. 


On [8,9], x(t)=-t**9/362880+t**8/4480- 

t**7/126+701*t**6/4320-1511*t**5/720 
+51193*t**4/2880- 

212753*t**3/2160+1156699* t **2/3360- 
1158379*t/1680+43896157/72576. 


On [9,10], x(t)=t**10/3628800-t**9/36288+11* t**8/8960- 
323*t**7/10080+ 

1873*t**6/3456- 
89269*t**5/14400+ 279533*t**4/5760- 

7761511* t **3/30240+23602499*t**2/26880 
-23615939*t/13440+ 

5681592251/3628800. 
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Figure 12.1 [Python] The solution x(t) for the DDE equation (12.2) for — 1 < t < 10. The initial history 
function in this case was x(t) = 1 on [-1, 0]. 


Figure 12.1 shows the solution obtained by the method of steps for - 1 < t < 


10. The Python program is listed in Section 12.5 and uses the piecewise 
command from the NumPy package. The next example shows how the initial 
history function affects the solution for t > 0. 


Example 2. Solve the simple linear DDE (12.2) with initial history functions 
on [-1, 0] given by: (a) x(t) = e 5 (b) x(t) = t 7; (©) x(t) = t; (d) X(t) = sin(t). 


Solution. The graphical solutions are shown in Figure 12.2. 


Figure 12.2 Solutions to the DDE (12.2) with initial history functions on [-1, 0] defined by: (a) x(t) = e t 


(b) xO = t’; (©) x = t; @) x(O = sin(0. 


Linear Stability Analysis. As with ODEs it is important to establish the 
location and stability of critical points of DDEs. A critical point of a DDE of the 
form (12.1) satisfies the equation 


f (x*,x*,...,x*) = 0, 


where x * is a critical point of system (12.1). The methods to determine the 
location and stability of critical points of ODEs are covered in other chapters of 
the book. The process is similar with DDEs except that the solution space is an 
infinite-dimensional function space. Consider small perturbations from 
equilibrium in this space, then the displacements are time-dependent functions, 6 
x(t), say, that can persist for an interval at least the maximum value of t ;. In 


order to simplify the notation it is usual to write x , = x(t —t), which is what we 


will do here. Using methods similar to those described in Chapters 2 and 3, 
suppose that 


X = X“ + OX, 
take a Taylor series expansion and linearize to obtain 
6X = Jodx + Jr ôx +... + Je OX, (12.4) 
where the matrices J,, are Jacobians of the corresponding x,,. Supposing that 
DDEs have exponential solutions as with ODEs, then 
dx(t) = Ae”, 
where A is an eigenvalue of the Jacobian matrix. Substituting into (12.4) gives 
AA =A (Jo + e™ Ja +... + en). 
The characteristic equation is then given by 
[Jo + eJn +.. + ee — All = 0. (12.5) 


Expanding out the determinant leads to polynomials which include some terms 
in eùi and these are called quasi-polynomials . As with ODEs, if all of the 


solutions of equation (12.5) have negative real part, then the critical point is 
stable, otherwise it is unstable, or if some of the leading characteristic values are 


zero, the critical point is non-hyperbolic. Quasi-polynomials generally have an 
infinite number of roots in the complex plane and this is where Python can help 
in determining the stability of critical points. The method will now be illustrated 
by means of an example. 

In the next example, a type of logistic equation subject to delay is investigated. It 
is shown that there are two critical points and the stability of one of these points 
will be investigated. For this simple logistic DDE it is shown that a Hopf 
bifurcation takes place, where a stable critical point loses its stability and a stable 
limit cycle bifurcates from the point. 


Example 3. 
Investigate the logistic DDE given by 
dx 
a px(t)(1 — x(t — 71)), (12.6) 


with initial history function x(t) = 0. 1, on [-1, 0], t ; = 1, as the parameter p 
varies. 


Solution. For system (12.6) there are two critical points at x * = 0 and x * = 1. 
One can show that the trivial critical point at x * = 0 is unstable. Consider the 
critical point at x * = 1, where more interesting behavior is present. The 
characteristic equation is given by 


ne A =: (12.7) 
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Figure 12.3 Solutions to the DDE (12.4) with initial history function on [-1, 0] defined by x(t) = 0. 1 for 
varying values of the parameter u. (a) Time series showing that when p = 1. 2, x(t) approaches the stable 


0.40.60.81.01.21.4 


critical point at x * = 1, (b) Time series showing that when p = 1. 6, x(t) approaches a stable limit cycle. (c) 


Phase portrait showing that when u = 1. 2, x(t) approaches the stable critical point at x * = 1, (d) Phase 
portrait showing that when p = 1. 6, x(t) approaches a stable limit cycle. A linear stability analysis shows 


that the system goes through a Hopf bifurcation when u = 5e 


For the critical point x * = 1 to be stable, the complex roots of equation 
(12.7) must lie on the left half of the A plane. A Hopf bifurcation is a local 
bifurcation in which a critical point loses stability as a pair of complex conjugate 
eigenvalues cross the imaginary axis. Therefore, a bifurcation takes place when 
the roots lie on the imaginary axis. Suppose that A = 0 + iy, then equation (12.7) 
becomes 


pe" +iy=0 
or 
u (cos (yt1) — isin (yt,)) + ty = Q. 
Equating real and imaginary parts to zero, one obtains 
pcos OT) =0, y- usin QT) = 0. 


The first equation has solution yT = 2ntDT a= 0.1.2... and the minimum 


a 8 
order solution is found when n = 0, giving jit, = 4. Hence, a necessary and 
sufficient condition for the critical point at x * = 1 to be stable is uT; < 5, and 
when pit; > 5, the critical point goes through a bifurcation and becomes 


unstable and a small-amplitude limit cycle bifurcates from the critical point. 
Typical time series and phase portraits for the DDE logistic model are shown in 
Figure 12.3. 

The biological logistic DDE was first investigated by Hutchinson [15] in 1948 
who devised a more realistic single species model subject to time delays. These 
time delays could be a result of density dependent population growth, discrete 
breeding seasons, disease, food supply, and seasonal effects, for example. In 
2016, Agarwal [1] published a book on logistic DDEs and considers oscillation 
of delay logistic models and chapters also cover stability, piecewise arguments, 
food-limited populations, and diffusion. Predator-prey DDE models with disease 
in prey are investigated in [28], the effect of diffusion in predator-prey DDE 
models is covered in [10], and predator-prey DDE models with multiple delays 
are investigated in [5]. When considering DDE models in epidemiology, a pest 
management strategy is considered in [31], an analysis of an SEIRS model with 
two delays is investigated in [6], and global stability for DDE SIR and SEIR 
models with nonlinear incidence rate are discussed in [14]. 

Most processes in biology and especially in the human body are subject to 
some kind of time delay and this naturally leads to systems displaying oscillatory 
behavior. The next section concentrates on examples of DDEs in the field of 
biology. 


12.2 Applications in Biology 


Interacting species were discussed in some detail in Chapter 4 and the Lotka- 
Volterra predator-prey system was investigated. The next example illustrates 
what can happen when a delay is introduced in the equations. 


Example 4. 
Investigate the following delayed predator-prey model with a single delay: 


dx , 
— = x(t) (ri — 411 Xr — 412y7), 


dy 
T — = y(t) (—1r + Ag, XS Ay2Vz) (12.8) 


dt 


where r 4,1 5, 4 44, 4 12, A 21, A 99 are Constants and the delay t = 0 denotes the 
gestation period of the predator, and x , = x(t -1), y , = y(t -1). 


Solution. Without any delay, a typical Lotka-Volterra system displays periodic 
solutions which are affected by small perturbations. More interesting, and 
realistic, behavior results from introducing the gestation period of the predator. 
Suppose that r = 1,r = 1,a 4, = 1,a ņ2 = 1, a 9; = 2, A > = 1, and vary the 


gestation period t. Typical phase portraits are shown in Figure 12.4. When t= 1, 
there is a period-one limit cycle, when t = 1. 2, there is a period-two limit cycle, 
when T = 1. 25, there is a period-4 limit cycle, and when t = 1. 5, the system 
displays chaos. 
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Figure 12.4 Phase portraits of the DDE (12.8) with initial history function on [-t, 0] defined by x(t) = 
T, y(t) = t, whenr 4 =1,r9=1,4 41, =1,442= 1,424 = 2,4 99 = 1. When (a) t = 1, period-one limit 
cycle; (b) t = 1. 2, period-two limit cycle; (c) t = 1. 25, period-four limit cycle; (d) t = 1. 5, a chaotic 
solution. 


The human body is predominantly composed of periodic processes from the 
cellular and molecular level up to the organ and inter-organ system level. Many 
cells such as neurons, heart cells, muscle cells, retinal cells, and blood cells 
oscillate [22] and periodic processes in the human body encompass phenomena 
such as heartbeat rhythms, bacterial oscillations, cytoskeletal structures, genetic 
interactions, rhythmic behavior in growth and development and cancer, for 
instance, see [3] and [29]. 


In this section, the author has decided to concentrate on two physiological 
processes, namely hematopoiesis (the formation of blood cellular components) 
and angiogenesis (the development of new blood vessels) which include the 
dynamics of tumor growth from a dormant to a malignant state. More detailed 
information can be found in [19]. 

A DDE Model of Hematopoiesis. Consider the one-dimensional Mackey- 
Glass model related to hematopoiesis [21] defined by 

oe = PMT) ax), 
dt 1+x(t-T)’" 

(12.9) 
where x(t) is the blood cell population at time t, t is a constant time lag, and n is 
a constant. The first term in the right-hand side of equation (12.9) models the 
delayed production rate of the blood cells and 6 represents a death rate of blood 
cells. The DDE can be numerically solved with Python. Figure 12.5 (a) shows a 
phase portrait of equation (12.9) and Figure 12.5(b) shows the corresponding 
power spectrum (see Chapter 18) for parameter values f = 2, n = 10, T= 2, and ô 
= 0. 8. The Python program for plotting the solutions to the Mackey-Glass model 
is listed in Section 12.5. 
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Figure 12.5 [Python] Periodic behavior in the blood cell population model for equation (12.9) when £$ = 2, 
n= 10, t= 2, and 6 = 0. 8. (a) Phase portrait. (b) Power spectrum. 


Figure 12.6 (a) shows a phase portrait of equation (12.9) and Figure 12.6(b) 
shows the corresponding power spectrum for parameter values $p = 2, n = 10, T= 
2, and 6 = 1. 
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Figure 12.6 Chaotic behavior in the blood cell population model for equation (12.9) when £ = 2, n = 10, t 
= 2, and 6 = 1. (a) Phase portrait. (b) Power spectrum. 


Figure 12.7 shows the bifurcation diagram for system (12.9) obtained using 
the second iterative method with feedback. There are clearly regions of periodic 
behavior and regions of period doubling and un-doubling to and from chaos. 
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Figure 12.7 Bifurcation diagram for system (12.9) as the parameter 6 is increased linearly from 6 = 0 to 6 
= 1. 8, and then ramped back down again. Note that the single branches are depicting periodic solutions. 


To complete the study of the Mackey-Glass system, consider the following 
modified model with two constant time delays: 


dx Px(t—71) + Bx(t —T2) 
SS ee 
dt 14+((¢-1T,)+Px(t-T2)) 
(12.10) 
where the time delays are t ; and T 5. Fix the parameters f = 2. 4, n = 10, T4 =2. 
4, T> = 6. 2, and 6 = 2. Figure 12.8 shows the phase portrait and corresponding 


power spectrum and the system is clearly demonstrating quasiperiodic behavior. 
A double Hopf bifurcation is a local bifurcation in which a critical point has two 
pairs of purely imaginary eigenvalues. Generically, two branches of torus 
bifurcations evolve leading to periodic, quasiperiodic, and chaotic behaviors. 
Equation (12.10) allows double Hopf bifurcations. 
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Figure 12.8 Quasiperiodic behavior in the blood cell population model for equation (12.9) when £ = 2. 4, 
n = 10, T1 = 2. 4, T? = 6. 2, and ô = 2. (a) Phase portrait. (b) Power spectrum. 


DDE Model of Angiogenesis. The final biological example presents a 
mathematical model of angiogenesis . Angiogenesis is the process where new 
blood vessels are formed from pre-existing vessels and is vital in growth and 
development and is part of wound healing and the formation of granulation 
tissue. Unfortunately, there are also negative effects of angiogenesis particularly 
in the promotion of cancer growth. Following the work of Hahnfeltd [13], Agur 


et al. [2], and Bodnar et al. [4], the following DDEs can be used to model cancer 
growth: 


w = aN(t)(1 


N(t) ) 


1+f\(E(@-T1)) 


d= P(E)N(t) - 8P), 


E = RPE- T) -a(l 


(12.11) 
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Figure 12.9 A periodically forced angiogenesis model (12.10) with parameter values defined by (12.11) 
and m = 1.05 + 0. 1cos(#120): (a) t 1 = 1, T 2 = 1, periodic; (b) t 1 = 1, T 9 = 3, bursting; (c) tT, = 1,T2 =5, 


bursting; (d) t 1 = 3, T 2 = 3, amplitude modulation; (e) t 4 = 1, T 2 = 15, fast spiking; (f) t 1 = 10, t > = 10, 


large amplitude modulation in E(t). 


where N is the number of tumor cells or tumor size, P is the quantity growth 
factors known to be involved in supplying the tumor, and E represents the vessel 
density, where F = r, and V is the volume of blood vessels feeding the tumor. 


The functions f 4, f >, f 3, model tumor cell proliferation rate, the protein 
production rate, and the vessel growth rate, respectively, and are given by: 


b, E” ac> b3 7 — mD?) 
; 


oe a BO) 


Or) = 
fil ) m(t)*b3 £ p2 

a3 
(12.12) 
Take a = 1,a = 0. 4,a 3 = 1,b 1 =2.3,b 3 =1,c14 =1.5,c, = 1, and ô = 0. 34. 
The parameter m alters the stimulation of tumor vessel production and is taken to 
be: 


m(t) = 1.05 + 0.1 cos(t/120). 


Figure 12.9 shows a gallery of time series plots for the quantities N(t), P(t) and 
E(t) for system (12.11) subject to conditions (12.12) for varying parameter 
values of t į and t , when driven by a periodic stimulation of tumor vessel 


production, m(t) = 1.05 + 0. 1cos(t120). In Figure 12.9(a) there is regular 
oscillatory behavior; in Figure 12.9(b) one can see that bursting is starting to 
form and becomes well established in Figure 12.9(c). In Figure 12.9(d), there is 
large amplitude modulation in all N(t), P(t), E(t). In Figure 12.9(e), there is 
intermittent fast spiking and finally in Figure 12.9(f), there is large amplitude 
modulation in E(t) but not in P(t) or N(t). 


12.3 Applications in Nonlinear Optics 


Electromagnetic waves and optical resonators are discussed in some detail in 
Chapter 16 Here we present three DDE models from nonlinear optics. The first 
example is the Lang-Kobayashi semiconductor laser model with delayed optical 
feedback due to an external cavity formed from a regular mirror [18]. Secondly, 
the Ikeda DDE modeling a nonlinear passive cavity in a ring resonator, derived 
from the Maxwell-Debye equations for highly dispersive media is investigated. 
Readers should look at Chapter 16 for more details and a figure of a ring cavity 


is given there. Finally, delayed-dynamical optical bistability within and without 
the rotating wave approximation is introduced. 

The Lang-Kobayashi Equations. The Lang-Kobayashi (LK) equations 
model a conventional optical feedback laser and describe the dynamics of the 
complex electric field, E(t) = E x(t) + iE (t), and the inversion (number of 


electron-hole pairs, N(t) say) inside the laser. Two modeling assumptions are 
made: firstly, the feedback is relatively weak (a small percentage of the emitted 
light), and secondly the mirror is far away from the laser (typically several 
centimeters to meters). In dimensionless form, the DDEs are: 


Æ CAO N(1)E(t) + KEM- 7), 


TË = P-N(t)- (1 + NO)IEWP, 


dt 


(12.13) 
where T is the ratio of decay times, a is the linewidth-enhancement factor, k is 
feedback strength, P is pump current, and t is the delay time. Figure 12.10 shows 
a time series solution for the LK equations when a = 4, x = 0. 1, P = 1, T = 200, 
and t = 1000. The Python program is listed in Section 12.5 and uses pydelay — 
a python library for solving DDEs. 
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Figure 12.10 [Python] The solution | E(t) | for the DDE equation (12.13) for 9500 < t < 10000. 


The Ikeda DDEs. The Ikeda model is discussed in some detail in Chapter 16 
The coupled DDEs are given by: 


. d 
E=A+BE(t-Tc) ei), r£ = —ġ + |E (t — to 


where E is the electric field strength in a ring cavity, Ọ is a phase shift as light 
propagates around the ring, @ g is a linear phase shift, A is related to input 


intensity, B is related to dissipation in the cavity, t is the Debye relaxation time, 
and t ç is the delay time of light in the ring. The coupled DDE may be simplified 


[9] to obtain the Ikeda DDE: 


af = — +A’ [I + 2B cos (¢ (t — Tc) — hy) | i 
(12.14) 
It is shown in [9] that as well as displaying chaos, Hopf bifurcations to sine wave 
oscillations occur for small time delays and that square wave oscillations occur 
for large delays. Fix the parameters A = 2, B = 0. 4, t = 0. 8, Ọ ọ = 0 and vary the 
cavity delay time T c. 
Figure 12.11 shows two time series displaying chaos and a square wave 
oscillation. Readers will be asked to find a Hopf bifurcation to a limit cycle in 
the Exercises at the end of the chapter. 
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Figure 12.11 The Ikeda DDE (12.14) for parameter values A = 2, B = 0. 4, t= 0. 8, @ ọ = 0 and vary the 
cavity delay time T c. (a) t c = 7; (b) TC = 40. 


Delayed-Dynamical Optical Bistability Within and Without the Rotating 
Wave Approximation. The work to follow here is based on our recent papers 
[20] and [25]. We consider a bistable model of homogeneously broadened two- 
level atomic medium of length | placed inside a bulk ring cavity of length L. In 


the paper it is shown that the DDEs for the field components x 9 , are given by: 


dx “A. 2Cx_(T)(1—-i6) 
=r = lyl- C1. + i) x0 (t — To) — Pacer 

alls 

dxy 2Cx*(T)(1+67) 
dt 


= —(1 + i0)x,(t — To) — 2x; (T) — | (12.15) 


1+6%+|x9(7)[?](1+2424) 


& = —(1 + i@)x_(t— To) + eee. 


dt 


where | y | is the normalized input field amplitude; g = 2+ is the 


normalized cavity detuning with cavity mode frequency œw ,, input field 
frequency w z, and k is the cavity decay constant; y = £ is the cavity round 
- 


trip delay, where c is the velocity of light in a vacuum, Ca g is the 
yK 


cooperative parameter, where g is the coupling constant between the cavity field 
and the atoms, and y is the A-coefficient; pE 2(wo-w,) is the normalized atomic 
y 


detuning with the atomic transition frequency œ ọ, and finally n = 2% z. Note that 
X q(T) is the fundamental field component (of the same form within the Rotating 


Wave Approximation (RWA)) and the nonlinear source term for the first 
harmonic field component x , in equation (12.15) depends on x 9 and is of 


O ( 17); to the same order. 


When the delay is zero t = 0, the system can display three different forms of 
hysteresis as shown if Figure 12.12. 
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Figure 12.12 Bistable regions for system (12.15) when t = 0. (a) A counterclockwise bistable region in the 


fundamental field component when @ = 2, 6 = 8, C= 50, y= 1, k=0.1, anda = 1079, (b) A clockwise 
bistable cycle for the first harmonic field component when 90 = 0, 6 = 0, C = 24, K = 0. 1, y = 1, and À = 


1077. (c) A butterfly bistable region for the first harmonic field component when 9 = 2, 6 = 8, C = 50, y= 1, 
x=0.1,andA=107%. 


Readers are directed to the research papers [20] and [25] to see how time 
delays affect the bistable operations depicted in Figure 12.12; however, in the 
main, time delays cause instabilities to encroach upon the bistable regions. There 
are some exceptions to the rule however. Figure 12.13 shows a large butterfly 
bistable region for transverse Gaussian field effects within RWA when subject to 
a time delay. Readers can find further details in our paper [25]. 
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Figure 12.13 For certain parameter values with transverse Gaussian field effects within the RWA and 
with a nonzero time delay q, a large butterfly bistable region, isolated from any instabilities, is clearly 
evident. Please see [25] for more details. 


12.4 Other Applications 


The ENSO Environmental Model. The first example presented is a simple 
nonlinear model for the El Niño and La Niña phenomena in the Eastern Pacific 
Ocean. The El Nifio Southern Oscillation (ENSO) refers to the warming and 
cooling cycles of sea surface temperatures — the warm phase of the cycle is 
called El Niño and the cool phase is called La Niña. The ENSO events have been 
occurring for thousands of years and with the development of global warming 
and climate change over past decades the mathematical models have become 
increasingly important and heavily investigated. In 1988, Schopf and Suarez [24] 
devised a simple nonlinear DDE model for ENSO. Suppose that T(t) represents 
the temperature anomaly, which represents a small perturbation from the long- 
term temperature average. The DDE model is given by: 


dT 7 


— =T - T? =7T G7): 
dt PEE = T) 


(1? 1A) 


Figure 12.14 Phase portraits of the ENSO model (12.16) when r = 0. 7 and the initial history function is 
T(t) = 0. 1. (a) When T y, = 1.5, there is no oscillation. (b) When T yw = 5, there is an oscillation. 


where r represents the influence of the returning signal relative to local feedback 
and T „is the nondimensional delay representing the wave transit time. 


Figure 12.14 shows that when r = 0. 7, there is a bifurcation point where a limit 
cycle bifurcates (the bifurcation occurs at t ,, * 1. 84). The delay time in this 


model represents the time taken for equatorially trapped oceanic waves to 
propagate across the Pacific Ocean. When the delay time is below a certain 
threshold t „ © 1. 84, in this case, then there is no oscillation, this could explain 


the lack of ENSO phenomena in smaller bodies of water such as the Atlantic and 
Indian Oceans. At the current time, the most cited paper on ENSO was published 
in 1997 [32] and there is also a lot of information published on the web. 

A Simple DDE Neural Network Model. This work follows the paper by 
Gopalsamy and He [11] on stability in asymmetric Hopfield nets with 
transmission delays. Neural networks are covered in some detail in Chapter 20 A 
simple two-neuron coupled DDE network is given by: 


-1.5-1.0-05 f/ 0.5 1.0 1.5” 


Figure 12.15 A gallery of plots for system (12.17) for varying parameter values and initial history 
functions. (a) The solution approaches the stable critical point at the origin; (b) the system settles on to two 
oscillating solutions which are in-phase; (c) the system has settled on to an oscillatory solution where x(t) 
and y(t) are now out of phase; (d) the system has co-existing stable critical points and oscillatory solutions 
which depend upon the initial history functions. 


& = x(t) + ay, tanh (x(t — T1)) + a12 tanh (y (t — T2)) 
& = —y(t) + azı tanh (x (t — T))) + az tanh (y(t — 7), 


wo 


(12.17) 


where x, y are activation levels, a ;; denote couplings between the two 
neurons, and T 4, T are transmission delays. A linear stability analysis shows 
that the system can go through a Hopf bifurcation and a pitchfork bifurcation 
simultaneously. This is demonstrated in Figure 12.15, where the different 
dynamics of the system are shown in four plots. 

Figure 12.15 shows solutions to the two-neuron neural network DDE (12.17) 
with varying parameters and initial history functions. (a) Phase portrait showing 
that when a 41 = 4 49 = 71, 4a 9, = 2, a 5) =1,T, =T = 1, and the initial history 
functions, x(t) = y(t) = 0. 5, (x(t), y(t) approaches a stable critical point at the 
origin. (b) Phase portrait showing that when a 41 = -1, a 42 = A 9, = 72, a9 = 
-3,T 14 ZT, = 1, and the initial history functions, x(t) = y(t) = 0. 5, (x(t), y(t)) 
approaches in-phase oscillation. (c) Phase portrait showing that when a 44 = 0. 
33, d 49 = 71, 4 24 = 2,4 ə = 0.34,T 4 = T> = 1, and the initial history functions, 
x(t) = y(t) = 0. 5, (x(t), y(t) approaches out of phase oscillation. (d) Three time 
series showing that when a 4; = -1,4 4) = 2,4 5, = 3,4 232 = -1,T1 =T> = 1, and 
the initial history functions (i) x(t) = 2, y(t) = 1, (ii) x(t) = -1, y(t) = 1, and (iii) 
x(t) = —1, y(t) = —1, there are two stable critical points and one stable oscillation 
in x(t). 


12.5 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


Python Commands Comments 


dde23 # Imported from Pydelay to solve DDEs. 

lambdas # Creation of anonymous functions 
(without a name). 

piecewise # Evaluate a piecewise defined function. 

pow(x, y) # Return x to the power y. 


# Program 12a: The method of steps. 
# Analytical solution. 

from sympy import integrate, symbols 
xi, t, i = symbols(’xi t 1’) 


def phi(i, t): 
if i == 0: 
return 1 # Initial history x(t)=1 on [- 
1,0]. 
else: 
return phi(i-1, i-1) - integrate(phi(i- 
1, xi-1), (xi, i-1, t)) 
tmax=10; 
x = [phi(j, t) for j in range(tmax + 1)] 
print(’x(t) = {}’.format(x)) 


# Program 12b: Solution of a DDE using the method o 
f steps. 
# See Figure 12.1. The plot is a piecewise function 


# The lambda t: functions are computed in Programs 
12a. 


import numpy as np 
import matplotlib.pyplot as plt 


t = np.linspace(-1, 10, 1000) 


conditions = [t<=0, t>0, t>1, t>2, t>3, t>4, t>5, t 
>6, t>7, t>8, t>9] 


lambdas = [ 

lambda t: 1, 

lambda t: 1-t, 

lambda t: t**2/2-2*t+3/2, 

lambda t: -t**3/6+3*t**2/2-4*t+17/6, 

lambda t: t**4/24-2*t**3/3+15*t**2/4-17*t/2+149/24, 
lambda t 


t**5/120 + 5*t**4/24 - 2*t**3 + 109*t**2/12 

- 115*t/6 + 1769/120, 

lambda t: t**6/720 - t**5/20 + 35*t**4/48 - 197*t** 
3/36 

+ 1061*t**2/48 - 1085*t/24 + 26239/720, 

lambda t: - 
t**7/5040 + 7*t**6/720 - t**5/5 + 107*t**4/48 - 

521*t**3/36 + 13081*t**2/240 - 13201*t/120 + 463609 
/5040, 

lambda t: t**8/40320 - t**7/630 + 7*t**6/160 - 487* 
t**5/720 + 

3685*t**4/576 - 27227*t**3/720 + 39227*t**2/288 - 3 
9371*t/144 

+ 3157891/13440, 

lambda t: - 
t**9/362880 + t**8/4480 - t**7/126 + 701*t**6/4320 - 

1511*t**5/720 + 51193*t**4/2880 - 212753*t**3/2160 
+ 1156699*t**2/3360 

- 1158379*t/1680 + 43896157/72576, 

lambda t: t**10/3628800 - t**9/36288 + 11*t**8/8960 

- 323*t**7/10080 + 

1873*t**6/3456 - 89269*t**5/14400 + 279533*t**4/576 
0 

- 7761511*t**3/30240 + 23602499*t**2/26880 - 236159 
39*t/13440 

+ 5681592251/3628800 


plt.plot(t, np.piecewise(t, conditions, lambdas) ) 


plt.xlabel(’t’, fontsize=25) 
plt.ylabel(’x(t)’, fontsize=25) 
plt.tick_params(labelsize=25) 
plt.show() 


# Program 12c: The Mackey-Glass DDE. 
# See Figure 12.5(a). 
# pydelay must be on your computer 


import numpy as np 
import pylab as pl 
from pydelay import dde23 


# define the equations 
eqns = { 
x’ : '2 * x(t-tau) / (1.0 + pow(x(t- 
tau),p)) - x’ 


} 
#define the parameters 
params = { 
‘tau’: 2, 
‘p’ : 10 
} 


# Initialise the solver 
dde = dde23(eqns=eqns, params=params ) 


# set the simulation parameters 

# (solve from t=0 to t=1000 and limit the maximum s 
tep size to 1.0) 

dde.set_sim_params(tfinal=1000, dtmax=1.0) 


# set the history of to the constant function 0.5 ( 


using a python 
lambda function) 
histfunc = { 
’x’: lambda t: 0.5 


} 
dde.hist_from_funcs(histfunc, 51) 


# run the simulator 
dde.run() 


# Make a plot of x(t) vs x(t-tau): 
# Sample the solution twice with a stepsize of dt=0 
„1: 


# once in the interval [515, 1000] 
soli = dde.sample(515, 1000, 0.1) 
x1 = soli[’x’] 


# and once between [500, 1000-15] 
sol2 = dde.sample(500, 1000-15, 0.1) 
x2 = sol2[’x’] 


pl.plot(x1, x2) 
pl.xlabel(’$x(t)$’ ) 
pl.ylabel(’$x(t - 15)$’) 
pl.show( ) 


# Program 12d: The Lang-Kobayashi DDEs. 
# See Figure 12.10. 
# pydelay must be on your computer. 


import numpy as np 
import pylab as pl 
from pydelay import dde23 


tfinal = 10000 


tau = 1000 


# The laser equations 
laser_equations = { 
"E:c’: '0.5*(1.0+11*a)*E*n + K*E(t-tau)’, 


“n’ : '(p -n - (1.0 +n) * pow(abs(E),2))/T’ 
} 
params = { 
‘a’ 1: 4.0, 
pe : 1.0, 
'T’ : 200.0, 
"K’ : 0.1, 


‘tau’: tau, 
nu” : 10**-5, 
'nO’” : 10.0 


noise = { ’E’: ‘sqrt(0.5*nu* 


(n+nO)) (gwn() + iigwn())’ } 


dde = dde23(eqns=laser_equations, params=params, no 


ise=noise) 


dde.set_sim_params(tfinal=tfinal) 


# use a dictionary to set the history 


thist = np.linspace(0, tau, tfinal) 
Ehist = np.zeros(len(thist))+1.0 
nhist = np.zeros(len(thist))-0.2 


dic = {°C : thist, “Eos Ehist, '’n’: nhist} 


# 'useend’ is True by default in hist_from_dict and 
thus the 

# time array is shifted correctly 
dde.hist_from_arrays(dic) 


dde.run() 


t = dde.sol[’t’] 
E = dde.sol[’E’ ] 
n = dde.sol[’n’ ] 


spl = dde.sample(-tau, tfinal, 0.1) 


pl.plot(t[:-1], t[1:] - t[:-1], '0.8’, label=’step 
size’) 

pl.plot(spl[’t’], abs(spl[’E’]), ‘gg’, label=’sample 
d solution’ ) 

pl.plot(t, abs(E), ’.’, label=’calculated points’) 

pl.legend( ) 


pl.xlabel(’$t$’ ) 
pl.ylabel(’$|E|$’) 


pl.xlim((0.95*tfinal, tfinal)) 
pl.ylim((0,3)) 
pl.show( ) 


12.6 Exercises 


1. 
Use the method of steps to show that an analytical solution in the range [-1, 


2] to the DDE (12.2) with the initial history function x(t) = e ‘ on [-1, 0] is 


given by: 
a | -1 t 
fen-! ee reiih 
e e e 


Use Python to determine an analytical solution on [-1, 4]. 


Use the method of steps to show that an analytical solution in the range [-1, 
2] to the DDE (12.2) with the initial history function x(t) = t ? on [-1, 0] is 
given by: 


sa T Tne 2. F 
P,-t+ 0-2/3, 2-—4+2P-—+—}. 
12 3 3 12 


Use Python to determine an analytical solution on [-1, 4]. 


Use a linear stability analysis to prove that the critical point x * = 0 is stable 
for the system 


dx 
— = —xy(t - 1). 
dt u ) 


. Consider the logistic DDE subject to two delays: 


dx 
— = SUN) et Sr = x(t- T2)). 
dt 


Show that a necessary and sufficient condition for the critical point at 
x* = t to be stable is 


nT =) ae 


-+ 
(Ti + Tz) COS (5 eae 


Use Python to show a Hopf bifurcation of a limit cycle for suitable 
parameter values. 


"Plot a bifurcation diagram for the modified Mackey-Glass system (12.10) 
when f = 2.4, 6 = 2, n = 10, T4 = 2.4, as the parameter T 5 is linearly 
ramped up from T> = 0 to t = 10, and then ramped down again. 


Perform a linear stability analysis on the Ikeda DDE (12.14) and show that 
there exists both stable and unstable Hopf bifurcation points. 
. A simple ENSO environmental model with a global warming effect, W, say, 
is given by: 


dT : 
3, = PO - TO? -rT—ty) + W. 


Using the same parameters as those given in equation (12.16), investigate 


10. 


how the global warming term W affects the model. 


Consider the periodically forced mechanical oscillator described by the 
equations: 


dx [dx d: 
ata — b= + ex = P cos(wt) + A (i) + BUR), 


where constants a, b, c, and T are positive, x , = x(t —T), and T is a time 


delay. The feedback is negative if A, B < 0, and positive if A, B > 0. 
Suppose that a = 0. 3, b = 2, c =2,@=2,A=6, B= 2, T = 9, and vary the 
delay t. Plot phase portraits of x(t) versus x(t) when (i) t = 0. 4; (ii) t = 0. 


8; (iii) T= 1. 2. Describe the behavior in each case. Read paper [30], where 
a study of double Hopf bifurcation and chaos for this system is analyzed. 


Consider the simple mathematical model of an inverted pendulum that is 
balanced using linear feedback control [26]. Think of an inverted 
pendulum that is pivoted on a cart and the cart can move horizontally left 
and right. The system is modeled by a pair of DDEs: 

ao, (6) — F cos(6) do 2p 

— = sin() — Fcos(@¢), — = <LF, 

de dt? 3 


F=([cj@t-—t)+ ae ) 
=|c] T PTN T)|, 


where @ is an angular displacement of the inverted pendulum, c 4, € > are 


feedback control gains, ô is the horizontal displacement from the pivot 
point, F is a delayed feedback control force, L is the length of the 
pendulum, and t is a control loop latency. Use Python to investigate the 
system and show that there are parameter regions which show (i) 
stabilization to 0 = 0; (ii) small oscillations about 0 = 0; (iii) runaway 
oscillations, where 6 gets large, and (iv) chaotic solutions. 


Consider the economic model of neoclassical growth with both workers 
and capitalists [12], using the Cobb-Douglas production function, 


f (ki) = k?, where a € (0, 1), given by: 


dk 
a = (Sw +a (sc — Sw)) k(t — T)” — nk(t — T), 
C 


where k(t) denotes capital per worker, s y and s ç are the propensities for 


workers and capitalists to save, respectively, n > 0 is the constant labor 
force growth rate, and t represents a time lag in the production technology. 


Prove that there is a unique critical point at pa (x ie caw) and 


n 


T 


prove that there is a Hopf bifurcation point at T = — ao 


Bibliography 


[1] 


[2] 


[3] 


[4] 


[5] 


[6] 


[7] 


[8] 


[9] 


R.P. Agarwal, D. O’Regan and S.H. Saker, Oscillation and Stability of Delay Models in Biology, 
Springer, New York, 2016. 
[zbMATH] 


Z. Agur, L. Arakelyan, P. Daugulis and Y. Dinosaur, Hopf point analysis for angiogenesis models, 
Discrete and Continuous Dynamical Systems-Series B 4, (2004), 29-38. 
[MathSciNet][Crossref] 


B.J. Altman, Cancer Clocks Out for Lunch: Disruption of Circadian Rhythm and Metabolic 
Oscillation in Cancer, Front. Cell Dev. Bill. 4:62. doi: 10.3389/fcell.2016.00062. eCollection (2016). 


M. Bodnar, M.J. Piotrowska, U. Forys and E. Nizinska, Model of tumour angiogenesis - analysis of 
stability with respect to delays, Math. Biosciences and Eng, 10, (2013), 19-35. 
[MathSciNet][Crossref] 


K. Chakraborty, M. Chakraborty and T.K. Kar, Bifurcation and control of a bioeconomic model of a 
prey-predator system with a time delay, Nonlinear Analysis-Hybrid Systems 5, (2011), 613-625. 
[MathSciNet][zbMATH] 


K.L. Cooke and P. van den Driessche, Analysis of an SEIRS epidemic model with two delays, J. 
Math. Biol. 35 (1996), 240-260. 
[MathSciNet][Crossref] 


O. Diekmann, S. A. van Gils, S. M. V. Lunel and H. O Walther, Delay Equations: Functional- 
,Complex-, and Nonlinear Analysis, Springer, New York, 1995. 


T. Erneux, Applied Delay Differential Equations, Springer, New York, 2009. 
[ZzbMATH] 


T. Erneux, L. Larger, M.W. Lee and J.P. Goedgebuer, Ikeda Hopf bifurcation revisited, Physica D 


194, (2004), 49-64. 
[MathSciNet][Crossref] 


[10] T. Faria, Stability and bifurcation for a delayed predator-prey model and the effect of diffusion, J. of 
Math. Anal. and Appl. 254 (2001), 433-463. 
[MathSciNet][Crossref] 


[11] K. Gopalsamy and X.Z.He, Stability in asymmetric Hopfield nets with transmission delays, Physica D 
76, (1994), 344-358. 
[MathSciNet][Crossref] 


[12] L. Guerrini, Time delay in a neoclassical growth model with differential saving, Int. J. of Pure and 
Applied Mathematics 78, (2012), 999-1003. 


[13] P. Hahnfeltd, D. Paigrahy, J. Folkman and L. Hlatky, Tumor development under angiogenic signaling: 
a dynamical theory of tumor growth, treatment response, and postvascular dormancy, Cancer Res. 59, 
(1999), 4770-4775. 


[14] G. Huang, Y. Takeuchi, W. Ma et al., Global Stability for Delay SIR and SEIR Epidemic Models with 
Nonlinear Incidence Rate, Bulletin Math. Biol. 72 (2010), 1192-1207. 
[MathSciNet][Crossref] 


[15] G.E. Hutchinson, Circular causal system in ecology, Ann. New York Acad. Sci. 50, (1948), 221—246. 
[Crossref] 


[16] T. Insperger (Editor), T. Ersal (Editor), G. Orosz (Editor), Time Delay Systems: Theory, Numerics, 
Applications, and Experiments (Advances in Delays and Dynamics), Springer, New York, 2017. 


[17] M. Lakshmanan and D.V. Senthilkumar, Dynamics of Nonlinear Time-Delay Systems, Springer, New 
York, 2011. 
[Crossref] 


[18] R. Lang and K. Kobayashi, External optical feedback effects on semiconductor injection properties, 
IEEE J. of Quant. El. 16, (1980), 347-355. 


[19] S. Lynch and J. Borresen J, Oscillations, feedback and bifurcations in mathematical models of 
angiogenesis and haematopoiesis, in Handbook of Vascular Biology Techniques, Slevin M, McDowell 
G, Cao Y, Kitajewski J eds., Springer, New York, (2015), 373-390. 


[20] S. Lynch, R.A. Alharbey, S.S. Hassan and H.A. Batarfi, Delayed-dynamical bistability within and 
without rotating wave approximation, J. of Nonlinear Optical Physics and Materials 24, (2015), 
1550037. 


[21] M.C. Mackey and L. Glass, Oscillation and chaos in physiological control systems, Science 197 
(1977) 287-289. 


[22] P.E. Rap, An atlas of cellular oscillators, J. Exp. Biol. 81 (1979), 281-306. 


[23] E. Schmitt, Uber eine Klasse linearer funktionaler Differentialgleichungen, Math. Ann. 70, (1911), 
499-524. 


[24] P.S. Schopf and M.J. Suarez (1988) Vacillations in a coupled ocean-atmosphere model, J. Atmos. Sci. 


[25] 


[26] 


[27] 


[28] 


[29] 


[30] 


[31] 


[32] 


bf 45 (1988), 549-566. 
[Crossref] 


Y.A. Sharaby, S. Lynch and S.S. Hassan, Inhomogeneous and transverse field effects on time delayed 
optical bistability inside and outside the rotating wave approximation, J. of Nonlinear Optical Physics 
and Materials 25, (2016), 1650021. 

[Crossref] 


J. Sieber and B. Krauskopf, Complex balancing motions of an inverted pendulum subject to delayed 
feedback control, Physica D 197, (2004), 332-345. 
[MathSciNet][Crossref] 


H. Smith, An Introduction to Delay Differential Equations with Applications to the Life Sciences, 
Springer, New York, 2010. 


Y.N. Xiao and L.S. Chen, Modeling and analysis of a predator-prey model with disease in the prey, 
Math. Biosciences 171 (2001), 59-82. 
[MathSciNet][Crossref] 


S. Yom-Tov and I. Golani, Oscillators in the human body and circular-muscle gymnastics, Med. 
Hypothesis 41 (1993), 118-122. 
[Crossref] 


P. Yu, Y. Yuan and J. Xu, Study of double Hopf bifurcation and chaos for an oscillator with time 
delayed feedback, Communications in Nonlinear Science and Numerical Simulation 7, (2002), 69-91. 
[MathSciNet][Crossref] 


H. Zhang, L. Chen and J.J. Nieto, A delayed epidemic model with stage-structure and pulses for pest 
management strategy, Nonlin. Anal. Real-World Appl. 9 (2008), 1714—1726. 
[MathSciNet][Crossref] 


Y. Zhang, J.M. Wallace and D.S. Battisti, DS, ENSO-like interdecadal variability: 1900-93, J. of 
Climate 10 (1997), 1004—1020. 
[Crossref] 


© Springer International Publishing AG, part of Springer Nature 2018 
Stephen Lynch, Dynamical Systems with Applications using Python 
https://doi.org/10.1007/978-3-319-78145-7_13 


13. Linear Discrete Dynamical Systems 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To introduce recurrence relations for first-and second-order difference 
equations. 

e To introduce the theory of the Leslie model. 

e To apply the theory to modeling the population of a single species. 


On completion of this chapter, the reader should be able to 


solve first-and second-order homogeneous linear difference equations; 
find eigenvalues and eigenvectors of matrices; 

model a single population with different age classes; 

predict the long-term rate of growth/decline of the population; 
investigate how harvesting and culling policies affect the model. 


This chapter deals with linear discrete dynamical systems, where time is 
measured by the number of iterations carried out and the dynamics are not 
continuous. In applications this would imply that the solutions are observed at 
discrete time intervals. 

Recurrence relations can be used to construct mathematical models of 
discrete systems. They are also used extensively to solve many differential 
equations which do not have an analytic solution; the differential equations are 
represented by recurrence relations (or difference equations) that can be solved 
numerically on a computer. Of course one has to be careful when considering the 
accuracy of the numerical solutions. Ordinary differential equations are used to 
model continuous dynamical systems in the first part of the book. More 
information on discrete systems can be found in the textbooks [1, 2], and [5]. 

The bulk of this chapter is concerned with a linear discrete dynamical system 
that can be used to model the population of a single species. As with continuous 


systems, in applications to the real world, linear models generally produce good 
results over only a limited range of time. The Leslie model introduced here is 
useful when establishing harvesting and culling policies. References [3, 4, 6, 7, 
8, 9], and [10] are concerned with the Leslie model. 

Nonlinear discrete dynamical systems will be discussed in the next chapter, 
and the Poincaré maps introduced in Chapter 9, for example, illustrates how 
discrete systems can be used to help in the understanding of how continuous 
systems behave. 


13.1 Recurrence Relations 


This section is intended to give the reader a brief introduction to difference 
equations and illustrate the theory with some simple models. 

First-Order Difference Equations 

A recurrence relation can be defined by a difference equation of the form 


Xn+1 = J an: (13.1) 


where x „+1 is derived from x „and n = 0, 1, 2, 3,.... If one starts with an 
initial value, say, x 9, then iteration of equation (13.1) leads to a sequence of the 
form 


bs : i= 0 to co} E EEE EEEE TE TEEN 


In applications, one would like to know how this sequence can be interpreted 
in physical terms. Equations of the form (13.1) are called first-order difference 
equations because the suffices differ by one. Consider the following simple 
example. 


Example 1. 
The difference equation used to model the interest in a bank account 
compounded once per year is given by 


3 
e = (1+ 25m n=0, 1; 2, 3ra 


Find a general solution and determine the balance in the account after five years 
given that the initial deposit is 10,000 dollars and the interest is compounded 
annually. 


Solution. Using the recurrence relation 


3 
= | 1 + — | x 10, 000, 
X] + al X 1U, UJU, 


J 
3 3y 
X2 = (1+ z5 = | +) x 10,000, 


and, in general, 


where n = 0, 1, 2, 3, .... Given that x ọ = 10, 000 and n = 5, the balance after five 
years will be x 5 = = 11, 592. 74 dollars. 


Theorem 1. 
The general solution of the first-order linear difference equation 


oe = MX +c, n=0Q0,1,2,3,..., (13.2) 
is given by 
n a nle if m 1 
Xn = M Xo + m . 
nc if m= 1. 
Proof (Proof.). 


Applying the recurrence relation given in (13.2) 


xX; = MXo +c, 
X2 = mx, +C = mM xo+ mce +c, 


) 
X3 = MX) +C = mM? Xo +m cme +C, 
and the pattern in general is 
5 


Xp = M’ xo + (M! +m? +...+m+ le. 


Using geometric series, „”-! n-2 = mi = m-l, provided that m # 
8 mM A atm p 


1. If m = 1, then the sum of the geometric sequence is n. This concludes the 


proof of Theorem 1. Note that, if | m | < 1 then x, > 7— asn > œ. 


Second-Order Linear Difference Equations 

Recurrence relations involving terms whose suffices differ by two are known 
as second-order linear difference equations . The general form of these 
equations with constant coefficients is 


AXn+2 = Dai + CXp. (13.3) 


Theorem 2. 
The general solution of the second-order recurrence relation ( 13.3 ) is 


MH kia, he. 
where k ,, k 5 are constants and à , A 5 are the roots of the quadratic equation 
aA? — bà - c = 0. IfA , =A 5, then the general solution is of the form 
Xn = (kz Fanka): 
Note that when A , and 4 5 are complex, the general solution can be expressed as 
Xn = kal + kody = ky(re”)" + kore)" = r" (Acos(n@) + Bsin(né)), 


where A and B are constants. When the eigenvalues are complex , the solution 
oscillates and is real. 


Proof. 
The solution of system (13.2) gives us a clue where to start. Assume that x , =A 


n k is a solution, where A and k are to be found. Substituting, equation (13.3) 
becomes 


aA k= bA k+ Ak 
or 


A"k(ad? — bà- c) = 0. 


Assuming that À ” k # 0, this equation has solutions if 


(12 A) 


\ivetT) 


ad? —bA-c=0. 


Equation (13.4) is called the characteristic equation . The difference 
equation (13.3) has two solutions and because the equation is linear, a solution is 
given by 


Xn = kay + k24}, 
where A ; #A are the roots of the characteristic equation. 
If A , =A 5, then the characteristic equation can be written as 


ad’ —-bA-—c=a(A-aA\y = ad? -2adAt ali: 


Therefore, b = 2aA , and c = -aÀ 4 ?. Now assume that another solution is of 


the form knà ". Substituting, equation (13.3) becomes 

AXni2 — bXn41 — CXp = a(n + e -b(n + ee — enka}, 
therefore 

Cie = DG = C = RA (aa? — ba, — c) + kA, (aA; — b), 


which equates to zero from the above. This confirms that knà ,, is a solution 
to equation (13.3). Since the system is linear, the general solution is thus of the 
form 


Xn = (k3 P nka)ay. 


The values of k ; can be determined if x 9 and x ; are given. Consider the 
following simple examples. 


Example 2. Solve the following second-order linear difference equations: 
(i) X m2 =X pay + 6X p n = 0, 1, 2, 3,..., given that x 9 = 1 andx , = 2; 
(ii) X p2 = 4X py 7 4X pœ N = O, 1, 2, 3, ..., given that x 9 = 1 and x ; = 3; 
(iii) X 2 =X m1 ~X pn =O, 1, 2, 3,..., given that x o = 1 andx , =2. 


Solution. (i) The characteristic equation is 


V-A-6=0, 


which has roots at A 4 = 3 and A 5 = —2. The general solution is therefore 


Dmh thE wa 0)1,253iuc 


The constants k į and k 5 can be found by setting n = 0 and n = 1. The final 


solution is 
4 | 
. = z? + gO MSO L2 Naver 
(ii) The characteristic equation is 
V —404+4=0, 
which has a repeated root at A 4 = 2. The general solution is 
Xn = (k3 + kan)2", n=0Q,1,2,3,.... 
Substituting for x ọ and x , gives the solution 
ma AOLA ioa 
2 
(iii) The characteristic equation is 
Vv —-A+1=0, 
which has complex roots A= 
general solution is 
Kee kya, key. WE OY, 2, Spade 


Substituting for A ; and A 5, the general solution becomes 


ot: The 


ce + ka) eos (—] Pees - ko)sin (5); PENNE x00: 


Substituting for x 9 and x ; gives k; = 


Xn = cos (“") + VB sin (=), 7 ed at (Re rss 


Example 3. 

Suppose that the national income of a small country in year n is given by I, = S 
n+P,+G,, where S ,, P p and G „represent national spending by the 
populous, private investment, and government spending, respectively. If the 
national income increases from one year to the next, then assume that consumers 
will spend more the following year; in this case, suppose that consumers spend 

1 of the previous year’s income, then 5 ,, = 17. An increase in consumer 

6 n+] 6-1 
spending should also lead to increased investment the following year, assume 
that P 741 = S p11 7 S n. Substitution for S „ then gives Pp, = Al | oe oe 


Finally, assume that the government spending is kept constant. Simple 
manipulation then leads to the following economic model 


5 1 
In. = gim _ 6" +O (13.5) 


where I „is the national income in year n, and G is a constant. If the initial 
national income is G dollars and one year later is 3G dollars, determine 


(i) a general solution to this model; 
(ii) the national income after 5 years; and 


(iii) the long-term state of the economy. 


Solution. (i) The characteristic equation is given by 


5 1 
an = 0, 
6 6 
which has solutions 4} = 1 and 4, = L. Equation (13.5) also has a constant 


term G. Assume that the solution involves a constant term also; try I „ = k 3 G, 
then from equation (13.5) 


5 l 
kG = -kG — -kG + G, 
3 63 63 


and so x, = —1_— = 3. Therefore, a general solution is of the form 


l= kyt thd, + 3G. 
(ii) Given that I ọ = G and 7, = 2G; simple algebra gives k , =-5and k, =3. 


When n = 5, I, = 2. 856G, to three decimal places. 

(iii) Asn > œ, I „ > 3G, since |À; |< 1 and |À, |< 1. Therefore, the 
economy stabilizes in the long term to a constant value of 3G. This is obviously 
a very crude model. 

A general n-dimensional linear discrete population model is discussed in the 
following sections using matrix algebra. 


13.2 The Leslie Model 


The Leslie model was developed around 1940 to describe the population 
dynamics of the female portion of a species. For most species the number of 
females is equal to the number of males and this assumption is made here. The 
model can be applied to human populations, insect populations, and animal and 
fish populations. The model is an example of a discrete dynamical system. As 
explained throughout the text, we live in a nonlinear world and universe; since 
this model is linear, one would expect the results to be inaccurate in the long 
term. However, the model can give some interesting results and it incorporates 
some features not discussed in later chapters. The following characteristics are 
ignored—diseases, environmental effects, and seasonal effects. The book [9] 
provides an extension of the Leslie model, where individuals exhibit migration 
characteristics. A nonlinear Leslie matrix model for predicting the dynamics of 
biological populations in polluted environments is discussed in [7]. 
Assumptions: The females are divided into n age classes ; thus, if N is the 
theoretical maximum age attainable by a female of the species, then each age 
class will span a period of x equally spaced, days, weeks, months, years, etc. 


The population is observed at regular discrete time intervals which are each 

equal to the length of one age class. Thus, the kth time period will be given by 

tı = Œ. Define x ; (© to be the number of females in the ith age class after the 
n 


kth time period. Let b ; denote the number of female offspring born to one 
female during the ith age class, and let c ; be the proportion of females which 
continue to survive from the ith to the (i + 1)st age class. 


In order for this to be a realistic model the following conditions must be 
satisfied: 


O b= 0. dean 
(GÒ O0<c;<1, 1<i<n. 


Obviously, some b ; have to be positive in order to ensure that some births do 
occur and no c ; are zero, otherwise there would be no females in the (i + 1)st age 
class. 

Working with the female population as a whole, the following sets of linear 
equations can be derived. The number of females in the first age class after the 
kth time period is equal to the number of females born to females in all n age 
classes between the time t ,_; and t g thus 


k k-1 k-1 A 
1 = bix ) + box’ Met an, RD ry: 
The number of females in the (i + 1)st age class at time t ; is equal to the 
number of females in the ith age class at time t ,_,; who continue to survive to 
enter the (i + 1)st age class, hence 


ik) (k-1) 


Min] = cE 


Equations of the above form can be written in matrix form, and so 


(k) (k-1) 
xX by bo ba +++ Dry Dy \| >, 

a eo was Or 05 ae 
k k-1 
a =| 0&0... 0 0 xi E; 
x) 0 0 0 Cn-1 0 xE) 


or 
X®=LX®), k=1,2,.. 
where X € Sk” and the matrix L is called the Leslie matrix . 


Suppose that X © is a vector giving the initial number of females in each of 
the n age classes, then 


xD — LX® 


x2 = LX = DXO 


a SLX. 


Therefore, given the initial age distribution and the Leslie matrix L, it is 
possible to determine the female age distribution at any later time interval. 


Example 4. 

Consider a species of bird that can be split into three age groupings: those aged 
0-1 year, those aged 1-2 years, and those aged 2-3 years. The population is 
observed once a year. Given that the Leslie matrix is equal to 


0 3 1 
L=| 03 0 0], 
0 050 


and the initial population distribution of females is x , © = 1000, x , © = 2000, 
and x 3 ® = 3000, compute the number of females in each age group after 

(a) 10 years; 

(b) 20 years; 

(c) 50 years. 


Solution. Using the above, 


5383 
(a) X09 = LOX® =| 2177 
mi2 


>” 


7740 
(b) X2® = 20x = | 2388 
1097 


>’ 


15695 
(c) XO) = LX =| 4603 
2249 


The numbers are rounded down to whole numbers since it is not possible to 
have a fraction of a living bird. Obviously, the populations cannot keep on 
growing indefinitely. However, the model does give useful results for some 
species when the time periods are relatively short. 

In order to investigate the limiting behavior of the system it is necessary to 
consider the eigenvalues and eigenvectors of the matrix L. These can be used to 
determine the eventual population distribution with respect to the age classes. 


Theorem 3. Let the Leslie matrix L be as defined above and assume that 
(a)b;20for1<i<n; 
(b) at least two successive b ; are strictly positive; and 
(c)O<c,;<1lforl<i<n. 
Then, 
(i) matrix L has a unique positive eigenvalue, say, À , ; 
(ii) A į is simple, or has algebraic multiplicity one; 
(iii) the eigenvector—xX , , say—corresponding to A , , has positive 
components; 
(iv) any other eigenvalue, À ; 4A , , of L satisfies 


il < AL, 
and the positive eigenvalue A , is called strictly dominant . 
The reader will be asked to prove part (i) in the exercises at the end of the 
chapter. 


If the Leslie matrix L has a unique positive strictly dominant eigenvalue, 
then an eigenvector corresponding to A 4 is a nonzero vector solution of 


LX = Ax: 


Assume that x ų = 1, then a possible eigenvector corresponding to À ; is given 
by 


C1C2...Cn— 1 
an! 
l 


Assume that L has n linearly independent eigenvectors, say, X 4, X 9,...,X p 


Therefore, L is diagonizable. If the initial population distribution is given by X © 
= X o then there exist constants b 4, b >, ..., b „ such that 
Xo = bX, + b2Xə +... + b, Xn. 
Since 
XO Six) -mnd EX Sax, 
then 
X = LKB X) + bX +... + bp Xn) = Di ALK) + DARK +... bp AKXy. 


Therefore, 


k k 
x® =A [x + bo (=) Xə +... +b (Z) Xa ky 
l l 


Since À , is dominant, 


Ài 


< ] f0rÀ;#À 1, and aa — oo, Thus 


ay A] 


for large k, 
x ~ by AEX. 


In the long run, the age distribution stabilizes and is proportional to the 
vector X ,. Each age group will change by a factor of A , in each time period. The 


vector X į can be normalized so that its components sum to one, the normalized 


vector then gives the eventual proportions of females in each of the n age 
groupings. 

Note that if A ; > 1, the population eventually increases; if A 4 = 1, the 
population stabilizes, and if A į < 1, the population eventually decreases. 


Example 5. Determine the eventual distribution of the age classes for 
Example 4. 


Solution. The characteristic equation is given by 


-à 3 1 
det(L-AN=|0.3 -A 0 |= -2? +0.94 +0.15 = 0. 
0 0.5 -A 


The roots of the characteristic equation are: 
A, = 1.023, Aap = -0.851, Az = —0.172, 


to three decimal places. Note that A 4 is the dominant eigenvalue. 
To find the eigenvector corresponding to A ;, solve 


—1.023 3 l X| 0 
0.3 -1.023 0 Xx |=| 0 
0 OS:  —1.023 J \ x3 0 


One solution is x , = 2.929, x 5 = 0. 855, and x 3 = 0. 420. Divide each term 
by the sum to obtain the normalized eigenvector 


0.696 
X, =| 0.204 
0.1 


Hence, after a number of years, the population will increase by 
approximately 2. 3% every year. The percentage of females aged 0—1 year will 
be 69. 6%; aged 1-2 years will be 20. 4%; and aged 2-3 years will be 10%. 


13.3 Harvesting and Culling Policies 


This section will be concerned with insect and fish populations only since they 
tend to be very large. The model has applications when considering insect 
species which survive on crops, for example. An insect population can be culled 
each year by applying either an insecticide or a predator species. Harvesting of 
fish populations is particularly important nowadays; certain policies have to be 


employed to avoid depletion and extinction of the fish species. Harvesting 
indiscriminately could cause extinction of certain species of fish from our 
oceans. References [8] and [10] provide examples for the populations of yellow 
legged gulls in the Mediterranean and roach in rivers in Belgium, respectively. 

A harvesting or culling policy should only be used if the population is 
increasing. 


Definition 1. A harvesting or culling policy is said to be sustainable if the 
number of fish, or insects, killed and the age distribution of the population 
remaining are the same after each time period. 


Assume that the fish or insects are killed in short sharp bursts at the end of each 
time period. Let X be the population distribution vector for the species just 
before the harvesting or culling is applied. Suppose that a fraction of the females 
about to enter the (i + 1)st class are killed, giving a matrix 


d 00-0 
Od 0 ::: O 
D=\ 0 0 dy. 0 
O 00d 
By definition, 0 < d ; < 1, where 1 <i < n. The numbers killed will be given 
by DLX and the population distribution of those remaining will be 
LX — DLX = (I — D)LX. 
In order for the policy to be sustainable one must have 
(I — D)LX = X. (13.6) 


If the dominant eigenvalue of (I — D)L is one, then X will be an eigenvector 
for this eigenvalue and the population will stabilize. This will impose certain 
conditions on the matrix D. Hence 


(L=d)) 0 0 fa 0 


0 (1 — do) 0 mes 0 
f=D= 0 0 (1 —d3) =- 0 
0 0 0 --+ (1 -d,) 


and the matrix, say, M = (I — D)L, is easily computed. The matrix M is also a 
Leslie matrix and hence has an eigenvalue A , = 1 if and only if 


(1=di bi + bci = di) + bps 1 — da) = dg) Fs 


+b,C1 ...Cn-1(1 - d1)... -dp,) = 1. (13.7) 


Only values of 0 < d ; < 1, which satisfy equation (13.7) can produce a 


sustainable policy. 
A possible eigenvector corresponding to À 4 = 1 is given by 


1 
(1 - d2)c1 
X, = (1 — dy) — d3)cic2 


(1 = də). . (1 = dn )C {C2 wea CA] 


The sustainable population will be C 4 X 4, where C , is a constant. Consider 


the following policies: 
Sustainable Uniform Harvesting or Culling. Let d=d,=d,)=...=d,, 


then (13.6) becomes 
(1 —d)LX = X, 


which means that 2, = oS Hence a possible eigenvector corresponding to 
= 


A , is given by 


X = a2 
C1 C2...Cy—] 
hee 
Sustainable Harvesting or Culling of the Youngest Class. Let d , = d and 
d,=d3=...=d, =0, therefore equation (13.7) becomes 
(1 — d)(b, + boc + b3C1C2 Fese T bjC\Co sane Cea) = 
or, equivalently, 
(l-—d)R=1, 


where R is known as the net reproduction rate . Harvesting or culling is only 
viable if R > 1, unless you wish to eliminate an insect species. The age 
distribution after each harvest or cull is then given by 


1 
C] 
X = CIC? 


C{C2...Cy-] 


Definition 2. An optimal sustainable harvesting or culling policy is one in 
which either one or two age classes are killed. If two classes are killed, then the 
older age class is completely killed. 


Example 6. 


A certain species of fish can be divided into three six-month age classes and has 
Leslie matrix 


4 3 
L=|05 0 0 
25 0 


The species of fish is to be harvested by fishermen using one of four different 


policies which are uniform harvesting or harvesting one of the three age classes, 
respectively. Which of these four policies are sustainable? Decide which of the 
sustainable policies the fishermen should use. 


Solution. The characteristic equation is given by 


-Aà 4 3 
det(L-AN=|0.5 -4 O | =A? +2A+ 0.375 = 0. 
0 0.25 -A 


The eigenvalues are given by A , = 1.5,A = —0. 191, andA 3 = —-1. 309 to 
three decimal places. The eigenvalue A , is dominant and the population will 


eventually increase by 50% every six months. The normalized eigenvector 
corresponding to À 4 is given by 


0.529 


X, =| 0.177 
0.294. 


So, after a number of years there will be 52. 9% of females aged 0—6 months; 
17.7% of females aged 6—12 months; and 29. 4% of females aged 12-18 
months. 

If the harvesting policy is to be sustainable, then equation (13.7) becomes 


(1 = d,)(b, =F boc (1 = də) T b3cic2(1 = d>)(1 = d3)) =], 
Suppose that h ; = (1 - d ,), then 
hyho(2 + 0.375h3) = 1. (13.8) 


Consider the four policies separately. 
(i) Uniform harvesting : let h = (h, h, h). Equation (13.8) becomes 


h?(2 + 0.375h) = 1, 


which has solutions h = 0. 667 and d = 0. 333. The normalized eigenvector is 
given by 


0.720 
Xi = 0.240 
0.040 


(ii) Harvesting the youngest age class: let h = (h 4, 1, 1). Equation (13.8) 
becomes 
hy(2 + 0.375) = 1, 


which has solutions h į = 0. 421 and d į = 0.579. The normalized 
eigenvector is given by 


0.615 
Ra, =| 0.308 
0.077 


(iii) Harvesting the middle age class: let h = (1, h 5, 1). Equation (13.8) 
becomes 
hy(2 + 0.375) = 1, 


which has solutions h 5 = 0. 421 and d , = 0.579. The normalized 
eigenvector is given by 


0.791 
Xa, = 0. 1 67 
0.042 


(iv) Harvesting the oldest age class: let h = (1, 1, h 3). Equation (13.8) 
becomes 


1(2 + 0.375h3) = 1, 


which has no solutions if 0 < h } < 1. 

Therefore, harvesting policies (i)-(iii) are sustainable and policy (iv) is not. 
The long-term distributions of the populations of fish are determined by the 
normalized eigenvectors Xe xX Ay and x ia given above. If, for example, the 


fishermen wanted to leave as many fish as possible in the youngest age class, 
then the policy which should be adopted is the second age class harvesting. Then 


79. 1% of the females would be in the youngest age class after a number of 
years. 


13.4 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


eig # Gives eigenvalues and right 


rsolve # Solve a recurrence equation. 


# Program_13a: Computing bank interest. See Example 1. 
from sympy import Function, rsolve 

from sympy.abc import n 

x = Function(’x’); 

f = x(n+1) - (1+3/100) * x(n); 

sol = rsolve(f, x(n), {x(0):10000}); 

print(’x_n = ${}’.format(sol) ) 

x_5 = round(sol.subs(n, 5), 2) 

print(’x(5) = {:,}’.format(x_5)) 


x „ = 10000 * 1.03 **n 
x(5) = $11592. 74 


# Program_13b: Solving a second order recurrence re 
lation. 

# See Example 2. 

from sympy import Function, rsolve 

from sympy.abc import n 

x = Function(’x’); 

f = x(n+2) - x(nt+1) - 6*x(n); 

sol = rsolve(f, x(n), {x(0):1, x(1):2}); 

print(’x_n = {}’.format(sol) ) 


Xn = 4((-2)" + 4 x 3”) 


# Program_13c: The Leslie matrix. See Example 4. 


# Compute the population distribution after 50 year 
S 


# Determine the eigenvalues and eigenvectors of a L 
eslie matrix. 


import numpy as np 

import numpy.linalg as LA 

L = np.array([[0,3,1], [0.3,0,0], [0,0.5,0]]) 
XO = np.array([[1000], [2000], [3000]]) 

X_50 = np.dot(LA.matrix_power(L, 50), XO) 
X_50 = X_50.round() 

print(’X(50) = {}’.format(X_50) ) 

dL,VL = LA.eig(L) 

print(’Eigenvalues = {}’.format(dL)) 
print(’Eigenvectors = {}’.format(VL)) 


X(50) = [[15696], [4604], [2249]] 

Eigenvalues = 1.02305, —0.850689, —0.172356 

Eigenvectors = [[0.950645, 0.278769, 0.136245], [—0.925557, 0.326403, 
— 0.191846], 

[0.184033, —0.320326, 0.929259] 


13.5 Exercises 
The difference equation used to model the length of a carpet, say, l ,,, rolled 
n times is given by 
lai = h +a eon): n=0,1,2,3,..., 
where c is the thickness of the carpet. Solve this recurrence relation. 


Solve the following second order linear difference equations: 


(a) 


X p2 = DX p1 ` 6X p N =O, 1, 2,3,...,, 18x 9 = 1x1, =4 


(b) 
Xn+2 = Xn+] Tzi Lyp n= 0, 1, 2, Zrii if x= 1,x 1 = 2; 
(c) l 
X p2 Z 2X p1 7 2X p N =O, 1,2,3,..ifx0=1,x1=2; 
(d) 


Foy =F ai tF p n=0,1,2,3,...,ifF ,=1andF ,= 1 (the 
sequence of numbers is known as the Fibonacci sequence ); 


(e) 


X na =X p1 + 2X p- f(n), n = 0, 1, 2,..., given that x ọ = 2 and x4 = 3, 
when (i) f(n) = 2, (ii) f(n) = 2n, and (iii) f(n) = e ” (use Python for part 
(iii) only). 


Consider a human population that is divided into three age classes; those 
aged 0-15 years, those aged 15-30 years, and those aged 30—45 years. The 
Leslie matrix for the female population is given by 


O 1 05 
L=|09 0 0 
O 0.8 0 


Given that the initial population distribution of females is x , © = 10000, x 
5 = 15000, and x 3 ® = 8000, compute the number of females in each of 
these groupings after 


(a) 
225 years; 


(b) 
750 years; 


) 
1500 years. 


Consider the following Leslie matrix used to model the female portion of a 
species 


0 0 6 
—| 1 
L=| 400 

050 


Determine the eigenvalues and eigenvectors of L. Show that there is no 
dominant eigenvalue and describe how the population would develop in 
the long term. 


Consider a human population that is divided into five age classes: those 

aged 0-15 years, those aged 15-30 years, those aged 30—45 years, those 
aged 45-60 years, and those aged 60-75 years. The Leslie matrix for the 
female population is given by 


O 1 1500 
09 0 0 00 
L=| 0 08 0 00 
o 0 0700 


0o 0 0050 


Determine the eigenvalues and eigenvectors of L and describe how the 
population distribution develops. 


Given that 


where b ; => 0, 0 < c ; < 1, and at least two successive b ; are strictly 
positive, prove that p(A) = 1, if A is an eigenvalue of L, where 


bi bci is ea PEE 6a 
=—+ +...+ ——. 
a A? A” 
Show the following: 


(a) 


p(A) is strictly decreasing; 


(b) 
p(A) has a vertical asymptote at A = 0; 


c) 
pà) > OasàÀ > œ, 
Prove that a general Leslie matrix has a unique positive eigenvalue. 


A certain species of insect can be divided into three age classes: 0—6 
months, 6-12 months, and 12—18 months. A Leslie matrix for the female 
population is given by 


0 4 10 
L=|04 0 0 
0 02 0 


Determine the long-term distribution of the insect population . An 
insecticide is applied which kills off 50% of the youngest age class. 
Determine the long-term distribution if the insecticide is applied every six 
months. 


Assuming the same model for the insects as in Exercise 7, determine the 
long-term distribution if an insecticide is applied every six months which 
kills 10% of the youngest age class, 40% of the middle age class, and 60% 
of the oldest age class. 


In a fishery, a certain species of fish can be divided into three age groups 
each one year long. The Leslie matrix for the female portion of the 
population is given by 


0 3 36 
L=|400 
05 0 


Show that, without harvesting, the fish population would double each year. 
Describe the long-term behavior of the system if the following policies are 
applied: 


(a) 


10. 


harvest 50% from each age class; 


(b) 
harvest the youngest fish only, using a sustainable policy; 
(c) 
harvest 50% of the youngest fish; 
(d) l 
harvest 50% of the whole population from the youngest class only; 


(e) 
harvest 50% of the oldest fish. 


Determine an optimal sustainable harvesting policy for the system given in 
Exercise 9 if the youngest age class is left untouched. 
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Aims and Objectives 


e To introduce nonlinear one-and two-dimensional iterated maps. 
e To investigate period-doubling bifurcations to chaos. 
e To introduce the notion of universality. 


On completion of this chapter, the reader should be able to 


produce graphical iterations of one-dimensional iterated maps; 

test whether or not certain systems are chaotic; 

plot bifurcation diagrams; 

apply some of the theory to model simple problems from biology, economics, 
neural networks, nonlinear optics, and population dynamics. 


Most of the dynamics displayed by highly complicated nonlinear systems 
also appear for simple nonlinear systems. The reader is first introduced to the 
tent function, which is composed of two straight lines. The graphical method of 
iteration is introduced using this simple function since the constructions may be 
easily carried out with graph paper, rule, and pencil. The reader is also shown 
how to graph composite functions. The system can display periodicity, mixing, 
and sensitivity to initial conditions, the essential ingredients for chaos. 

The logistic map is used as a simple model for the population growth of an 
insect species. Bifurcation diagrams are plotted and period-doubling bifurcations 
to chaos are displayed. 

Bifurcation diagrams are plotted for the Gaussian map. Two-dimensional 
Hénon maps are investigated, periodic points are found, and chaotic (or strange) 
attractors are produced. 

The chapter ends with some applications from biology, economics, nonlinear 


optics, and neural networks. There are a number of textbooks available on 
discrete dynamical systems, for example, see [4, 7, 8], and [14]. Recent 
conferences have concentrated on applications of discrete dynamical systems, 
see [2] and [16], for example. 


14.1 The Tent Map and Graphical Iterations 


As a simple introduction to one-dimensional nonlinear discrete dynamical 
systems, consider the tent map , T: [0,1] > [0, 1] defined by 


T(x) = i 


<x< 
Bw - Dd TEE 


ma NIl- 


where 0 < p < 2. The tent map is constructed from two straight lines, which 
makes the analysis simpler than for truly nonlinear systems. The graph of the T 
function may be plotted by hand and is given in Figure 14.1. 


u/2 
j= 
°9 i 
X 
Figure 14.1 A graph of the tent function. 
Define an iterative map by 
Xn+1 = 1), (14.1) 


where x „ € [0, 1]. Although the form of the tent map is simple and the 


equations involved are linear, for certain parameter values, this system can 
display highly complex behavior and even chaotic phenomena . In fact, most of 
the features discussed in other chapters of this text are displayed by this 
relatively simple system. For certain parameter values, the mapping undergoes 
stretching and folding transformations and displays sensitivity to initial 


conditions and periodicity . Fortunately, it is not difficult to carry out simple 
iterations for system (14.1) as the following examples demonstrate. 


Example 1. Iterate the tent function (14.1) numerically for the following u and 
X o Values: 


Du=3: 
(i) xo = 4, (ii) xo = 4, (iii) x9 = 33 
(I) p= 1: 


. . i 1 BS : 
(i) Xo = 3, (it) Xo 


WI 
we 


(IT) w= 3: 


. F aas = E 
(i) xo = 3, (ii) xo = §, (iii) x9 = + 


sae 1 a 1 
, (ill) xo = 3, (iv) Xo = Fy 


ale 


. 1 E 
(i) xo = 3, (i) Xo = 


Solution. A calculator or computer is not needed here. It is very easy to carry 
out the iterations by hand. For the sake of simplicity, the iterates will be listed as 
{X 0 X pX 9) +++)X py---f- The solutions are as follows: 


. 1 1 1 1 : 
(i) (er pe ee 


ss (3 3 3 3 
(ili) (as Geeta one 


The orbits tend to points of period one in the range [o 1 |: 


a 


(iii) {2 13 3 9 21 33 93 105 315 591 J 


In case (i), the iterate x „+4 is equal to x „ for all n. This type of sequence 
displays period-one behavior . In case (ii), the iterate x „+> is equal to x , for all 


n, and the result is period-two behavior . In case (iii), the first 11 iterates are 
listed but other methods need to be used in order to establish the long-term 
behavior of the sequence. 


UV ) p= 2: 

ORETTE 

(5.5.39 8 FBP 

Ui) GRAS RAB BAR OF 

(iv) Th T th TE TE te Te Te Te te teh 


The sequences behave as follows: (i) there is period-one behavior, (ii) there 
is period-two behavior, (iii) there is a period-three sequence, and (iv) there is a 
period-five sequence. 


Example 2. Using the tent map defined by equation (14.1) when p = 2, 
compute the first 20 iterates for the following two initial conditions: 

(i) X 9 = O. 2; 

(ii) x ọ = 0.2001 = 0.2 + €. 


Solution. The iterates may be computed using Python. The first 20 iterates for 
both initial conditions are listed side-by-side in Table 14.1. 

The system clearly shows sensitivity to initial conditions for the parameter 
value p = 2. Comparing the numerical values in the second and third columns, it 
is not difficult to see that the sequences diverge markedly when n > 9. This test 
for sensitivity to initial conditions gives researchers a simple tool to determine 
whether or not a system is chaotic. A more in-depth description of chaos is given 
in Chapter 8 


The results of Examples 1 and 2 show that there is a rich variety of dynamics 
which system (14.1) can display. Indeed, a now famous result due to Li and 
Yorke [10] states that if a system displays period-three behavior , then the 
system can display periodic behavior of any period, and they go on to prove that 
the system can display chaotic phenomena. Hence when p = 2, system (14.1) is 
chaotic since it has a period-three sequence (Example 1(IV)(iii)). 


Table 14.1 The first 20 iterates for both initial conditions in Example 2. 


p a| a 
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Unfortunately, numerical iterations do not always give a clear insight into 
how the sequences develop as n gets large. Another popular method used to 
display the sequence of iterations more clearly is the so-called graphical method. 


The Graphical Method. From an initial point x 9, draw a vertical line up to 


the function, in this case, T(x). From this point, draw a horizontal line either left 
or right to join the diagonal y = x. The x-ordinate corresponds to the iterate x ; = 


T(x 9). From the point (x 4, T(x 9)), draw a vertical line up or down to join the 


function T(x). Draw a horizontal line from this point to the diagonal at the point 
(x 5, T(x 1)). The first two iterates are shown in Figure 14.2. 


The iterative procedure may be summarized as a simple repeated two-step 
algorithm. 


1. 
Draw a vertical line to the function (evaluation). 


T(x) 


T(xo) 


0 
0 Xo X1 Xo 1 


Figure 14.2 A possible graphical iteration when n = 2. 


2. 
Draw a horizontal line to the diagonal (feedback); go back to 1. 


The algorithm generates successive iterates along the x-axis, corresponding 
to the the sequence of points {X 9, X 1, X 2.3 X m -J 


To demonstrate the method, the numerical iterations carried out in Examples 
1 and 2 will now be repeated using the graphical method. 


Example 3. Iterate the tent function graphically for the following p and x 9 
values: 


(I) u = 


NI— 


. 1 ae 1 iiia 3. 
(i) xo = ï, (il) Xo = 5, (iii) Xp = ï’ 


(D p= 1: 
(i) Xp = 7 (ii) Xp = = 


(IT) w= 3: 


; 3 Bas 6 1; 
(i) xo = =, (ii) xo = FR, (Hi) X0 = 3 


(IV) =2: 
(7) Xo = 7 (ii) Xọ = 3 (iii) Xo = . (iv) Xo = ia’ 
(V) p= 2: 


(i) x 9 = 0. 2, (ii) x ọ = 0. 2001. 


Solution. Each of the diagrams (Figures 14.3—14.7) can be reproduced using 
Python. Most of the graphical iterations are self-explanatory; however, 
Figures 14.5(c) and 14.7 warrant further explanation. When u= 3, the tent map 


displays sensitivity to initial conditions and can be described as being chaotic. 
The iterative path plotted in Figure 14.5(c) appears to wander randomly. It is still 
not clear whether the path is chaotic or whether the path is periodic of a very 
high period. Figure 14.7 clearly shows the sensitivity to initial conditions. Again, 
it is not clear in case (ii) whether the path is chaotic or of a very high period. 

What is clear from the diagrams is that the three basic properties of chaos — 
mixing , periodicity , and sensitivity to initial conditions —are all exhibited for 
certain parameter values. 
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Figure 14.4 Graphical iterations when p = 1: (a) Xo = 


1 
3 


and (b) Xo = 2. 
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Figure 14.6 Graphical iterations when p = 2: (a) Xo = L; (b) Xo = 1; (c) Xo = L; and (d) Xo = i: 


14.2 Fixed Points and Periodic Orbits 


Consider the general map 


Xn+1 = f&n). (14.2) 


Definition 1. A fixed point , or point of period one, of system (14.2) is a point 
at which x „+1 = fX n) =X p for all n. 


For the tent map, this implies that T(x „) = x „ for all n. Graphically, the fixed 


points can be found by identifying intersections of the function T(x) with the 
diagonal. 

As with other dynamical systems, the fixed points of period one can be 
attracting, repelling, or indifferent. The type of fixed point is determined from 
the gradient of the tangent to the function, T(x) in this case, at the fixed point. 
For straight line segments with equation y = mx + c, it can be easily shown that if 


e m < -1, the iterative path is repelled and spirals away from the fixed point; 
e —1<m<0, the iterative path is attracted and spirals into the fixed point; 
e 0 <m <1, the iterative path is attracted and staircases into the fixed point; 
e m> 1, the iterative path is repelled and staircases away from the critical point. 
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Figure 14.7 [Python] Graphical iterations when p = 2: (a) Xo = L (linewidth=2), and (b) x g = 0. 2001, 


for 100 iterations (linewidth=0.5). 


When | m | = 1, the fixed point is neither repelling nor attracting and m = 0 is 
a trivial case. A test for stability of fixed points for nonlinear iterative maps will 
be given in Section 14.2. 

Using Definition 1, it is possible to determine the fixed points of period one 
for the tent map (14.1). If 0 < u < 1, the only fixed point is at x = 0 (see 
Figure 14.8) and since the gradient at x = 0 is less than one, the fixed point is 
stable. Note that the origin is called the trivial fixed point . 
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Figure 14.8 The intersection T(x) = x when 0 <p < 1. 


When p = 1, the branch px of T(x) coincides with the diagonal and all points 
lying in the interval 0 < x < 12 are of period one. Once the tent function crosses 
the diagonal the origin becomes unstable since the gradient of the tent map at 
this point now exceeds one. 

When 1 < p < 2, there are two fixed points of period one, x , = 0 and 


X12 = er (see Figure 14.9). 
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Figure 14.9 The intersections T(x) = x when 1 < p < 2. There are two intersections. 


Notation. Throughout this text, the periodic point given by x ; į will denote 


the jth point of period i . This notation is useful when determining the number of 
points of period i. For example, x 4 4 and x ; above are the two fixed points of 


period one. 


The gradient of the function T(x) is greater than one at x 4 4, so this point is 
unstable; the gradient of T(x) at the point x ; 5 is less than — 1. Therefore, this 
point is also unstable. 

In summary, when 0 < p < 1, there is one stable period-one point at x = 0; 
when p = 1, there are an infinite number of period-one points in the interval 0 < x 
< 1⁄2; and when 1 < p < 2, there are two unstable period-one points at x ; and x 
1,2: The obvious question then is, where do the paths go if not to these two points 


of period one? The answer to this question will be given later (see Exercise 3 in 
Section 14.7). 


Definition 2. For system (14.2), a fixed point of period N is a point at which x 
nen =F (Xp) =X » forall n. 


In order to determine the fixed points of period two for the tent map it is 
necessary to find the points of intersection of T (x) with the diagonal. Consider 
the case where p = 2, the methods below can be applied for any value of p in the 
interval [0, 2]. 

The function of the function T(T(x)) = T *(x) is determined by replacing x 
with T(x) in the mapping 


2x O0<x< 1 
Te x lexsl. 
Hence 
2T (x) 0< T(x) <4 


oa a 


The interval () < T(x) < 4 on the vertical axis corresponds to two intervals, 


namely, Q < y < T7! ( 1 ) and 7-1 ( 1 ) < x < | onthe horizontal axis. When p 


= 2, it is not difficult to show that 7-! ( 1 ) — lor 5, depending on the branch of 
2) 4 


T(x). The process may be repeated for T(x) lying in the interval | 1 , 1]: 


Therefore, T *(x) becomes 


4x O<x<} 

Loe ed 

T(x) = 2 — 4x oea 
` A= 2 GEG 
4-4x 3<x<1. 


This function intersects the diagonal at four points corresponding to x = 0, 
2/5, 23, and 44 as shown in Figure 14.10. 
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Figure 14.10 The graphs of T 2(x) and y = x when p = 2. 


The fixed points at x = 0 and x = 22 are of period one; therefore, there are 


two points of period two given by y; = : and y, = 4. Since the gradient of | 


T °(x) | is greater than one at these points, x 2,1 and x > > are unstable. 

It is not difficult to show that there are no period-two points for 0 < p < 1 and 
there are two points of period two for 1 <p < 2. 

To determine the fixed points of period three, it is necessary to find the 
points of intersection of T 3(x) with the diagonal. Consider the case where y = 2. 
The methods below can be applied for any value of p in the interval [0, 2]. 

The function T(T(T(x))) = T 3(x) is determined by replacing x with T(x) in the 
mapping for T *(x). Hence 


AT (x) O0< T(x) < i 
aaa aAa ge I ORG 
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The interval 0 < T(x) < on the vertical axis corresponds to two intervals, 


namely Q < y< T7! (+) and 7-1 (+) < y < | onthe horizontal axis. When p = 
— ~ 4 4 — — 
2, it is not difficult to show that p-! ( 1 ) _lor i, depending on the branch of 
4 8 


T(x). The process may be repeated for T(x) lying in the other intervals. 
Therefore, T *(x) becomes 
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This function intersects the diagonal at eight points corresponding to 
x 224 4 2 6, and as shown in Figure 14.11. Note that points of period 


r0? PO T7 


two do not repeat on every third cycle and hence do not appear here. 
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Figure 14.11 The graphs of T 3(x) and y = x when p = 2. 


The fixed points at x = 0 and x = 24 are of period one; therefore, there are six 


. . . pi A 
points of period three given by X31 = $432 = 5, X3,3 = 5X34 = 2X35 — $, 


a 


and X36 = $. Since the gradient of | T °(x) | is greater than one at these points, 


all six points are unstable. Thus an initial point close to the periodic orbit, but 
not on it, will move away and the orbits will diverge. 

This process may be repeated to determine points of any period for the tent 
map. Recall that the results due to Li and Yorke imply that the map contains 
periodic points of all periods. It is therefore possible to find points of period 10, 
10°, or even 10100, for example. There are also aperiodic (or nonperiodic) orbits 
and the system is sensitive to initial conditions. Similar phenomena are observed 
for three-dimensional autonomous systems in Chapter 8, in fact, most of the 
dynamics exhibited there appear for this much simpler system. 


14.3 The Logistic Map, Bifurcation Diagram, and 


Feigenbaum Number 


In the early 1970s, May [13] and others began to investigate the equations used 
by fish biologists and entomologists to model the fluctuations in certain species. 
Simple population models have been discussed in other chapters using 
continuous dynamical models but the analysis here will be restricted to simple 
nonlinear discrete systems. Perhaps the most famous system used to model a 
single species is that known as the logistic map given by 


Xn+1 = Tula) = HX = Xy); (14.3) 


where p is a parameter and 0 < x „ < 1 represents the scaled population size. 
Consider the case where p is related to the reproduction rate and x „ represents 


the population of blowflies at time n, which can be measured in hours, days, 
weeks, months, etc. Blowflies have a relatively short lifespan and are easy to 
monitor in the laboratory. Note that this model is extremely simple but as with 
the tent map a rich variety of behavior is displayed as the parameter p is varied. 
We note that scientists would find it difficult to change reproduction rates of 
individual flies directly; however, for many species the reproduction rate 
depends on other factors such as temperature. Hence imagine a tank containing a 
large number of blowflies. Experimentally, we would like to observe how the 
population fluctuates, if at all, at different temperatures. A population of zero 
would imply that the tank is empty and a scaled population of one would 
indicate that the tank is full. The numbers produced in this model would be 
rounded down to guarantee that fractions would be ignored as in the continuous 
case. 

It must be pointed out that this model does not take into account many 
features which would influence a population in real applications. For example, 
age classes, diseases, other species interactions, and environmental effects are all 
ignored. Even though many factors are left out of the equation, the results show 
a wide range of dynamical behavior which has been observed both 
experimentally and in the field. 

Consider the logistic map f „: [0, 1] > [0, 1] given by 


Xn+1 = Tiles 


where f ,(x) = px(1 — x). The parameter p lies in the interval [0, 4]. The graph 
of f „ is given in Figure 14.12. 


u/4 


% 1 


Figure 14.12 A graph of the logistic map function. 


As with the tent map, simple numerical and graphical iterations may be 
carried out for varying values of the parameter u. To avoid repetition, these tasks 
will be left as exercises at the end of the chapter. Instead, the analysis will be 
restricted to finding periodic points and plotting a bifurcation diagram. 

To find points of period one, it is necessary to solve the equation given by 

Fux) = ux(1 — x) = x, 
which gives the points which satisfy the condition x „+1 = x , for all n. There 
are two solutions given by x;,;=Oand y,, = | — +. The stability of the critical 
, 5 H 


points may be determined using the following theorem. 


Theorem 1. 
Suppose that the map f „(x) has a fixed point at x * | Then the fixed point is stable 


if 


<] 


d R 
<- Ji H (x ) 
and it is unstable if 


> 1. 


d : 
5 fl") 


Using Theorem 1, |4fu(0) 


dx 


. Thus the point x 4 ; is stable for 0 < p< 1 and 


dfulx1,2) 
dx 


unstable if u > 1. Since 


2— this fixed point is stable for 1 < u <3 


and is unstable when p < 1 or p > 3. 
To find points of period two, it is necessary to solve the equation given by 


fr) = eux — x) — ux(1 — x))) = x, (14.4) 


which gives the points which satisfy the condition x ,45 = X , for all n. Two 
solutions for equation (14.4) are known, namely x ; , and x ; 2, since points of 


period one repeat on every second iterate. Therefore, equation (14.4) factorizes 
as follows: 


a 1 yo 2 3n ee: E 
(r | i)a + (uo +wx- (u +) EO. 


The equation -y ? x? + (u? + u °)x - (u ? + p) = 0 has roots at 


_Htl+ y= Dut D aa u+l- yu-3)u +1) 


X22 = FT. 


*2,1 2u 2u 


Thus there are two points of period two when p > 3. Let b , = 3 correspond 
to the first bifurcation point for the logistic map. Now 


d o | 223 2. 3 2 
Fy fu 20) = AU” + 6px? =U + p)x + ue? 
and 


=i, 


d a 
< fa x21) 
when u=b=1+ V6: The value b 5 corresponds to the second 


bifurcation point for the logistic map. Hence x 5 ; and x > 5 lose their stability at 4 
= b » (check this using Python). 

In summary, for 0 < u < 1, the fixed point at x = 0 is stable and iterative paths 
will be attracted to that point. Physically, this would mean that the population of 


blowflies would die away to zero. One can think of the temperature of the tank 
being too low to sustain life. As u passes through one, the trivial fixed point 
becomes unstable and the iterative paths are attracted to the fixed point at 

x12 =1- T For 1 < p < b 4, the fixed point of period one is stable which 


means that the population stabilizes to a constant value after a sufficiently long 
time. As p passes through b ,, the fixed point of period one becomes unstable 


and a fixed point of period two is created. For b ; < u < b 5, the population of 


blowflies will alternate between two values on each iterative step after a 
sufficient amount of time. As p passes through b 5, the fixed point of period two 


loses its stability and a fixed point of period four is created. 

As with other dynamical systems, all of the information gained so far can be 
summarized on a bifurcation diagram. Figure 14.13 shows a bifurcation diagram 
for the logistic map when 0 < p < 3. 5. The first two bifurcation points are 
labeled b į and b >. 


Figure 14.13 The first two bifurcations for the logistic map. 


For other values of p, it is interesting to plot time series data obtained from 
the logistic map. Figure 14.14 shows iterative paths and time series data when x 
o = 0. 2 (assuming the tank is initially, say, l full) for the following four cases: 


(i) p = 2, (ii) p = 3. 2, (iii) p = 3. 5, and (iv) u = 4. 


Figure 14.14 Iterative paths and time series data representing the population of blowflies at time n. The 
population can vary periodically or in an erratic unpredictable manner. 


It is not too difficult to extend the diagram to cover the whole range of 
values for u, namely 0 < u < 4. The bifurcation diagram given in Figure 14.15 
was produced using Python. Thus even the simple quadratic function f ,,(x) = 


ux(1 — x) exhibits an extraordinary variety of behaviors as p varies from one to 
four. In the past scientists believed that in order to model complicated behavior 
one must have complicated or many equations. One of the most exciting 
developments to emerge from the realm of nonlinear dynamical systems was the 
realization that simple equations can lead to extremely complex seemingly 
random behavior. 

Figure 14.15 shows period-doubling bifurcations to chaos . This means that 
as u increases beyond b ,, points of period one become period two; at b 5 points 


of period two become period four, and so on. The sequence of period-doublings 
ends at about p = 3. 569945. .., where the system becomes chaotic. This is not the 
end of the story; however, Figure 14.16 clearly shows regions where the system 
returns to periodic behavior, even if for only a small range of p values. These 
regions are called periodic windows . 

Near to the period-three window, the logistic map can display a new type of 
behavior known as intermittency , which is almost periodic behavior interrupted 
by occasional chaotic bursts. A graphical iteration and time series plot are shown 
in Figure 14.17. The intermittent nature becomes more evident as more points 
are plotted. 

The geometry underlying this behavior can be seen by plotting a graphical 
iteration for f ,, 3 when p = 3. 8282, for example. This is left as an exercise for the 


reader. As the parameter p is increased, the length of the intervals of chaotic 
bursts become larger and larger until the system becomes fully chaotic. This 
phenomenon is known as an intermittency route to chaos and appears in many 
other physical examples. 


Figure 14.15 [Python] The bifurcation diagram of the logistic map produced using the first iterative 
method (see Chapter 16). 
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Figure 14.16 [Python] A magnification of the bifurcation diagram for the logistic map in the range 3. 5 < 
ps4. 


An even more remarkable discovery was made by Mitchell J. Feigenbaum in 
the mid-1970s and involves the concept of universality . The first seven 
bifurcation points computed numerically are given by b į = 3.0,b 5 =3. 


449490...,b 3 = 3. 544090. .., b 4 = 3. 564407..., b 5 = 3. 568759..., b ¢ = 3. 
569692..., and b 5 = 3.569891.... Feigenbaum discovered that if d ;, is defined by 
d =b k17 b p then 


d _ 4.669202... 


ô = lim 
k>œ Ake | 
The number 6, known as the Feigenbaum constant , is much like the 
numbers 7 and e in that it appears throughout the realms of science. The constant 
6 can be found, not only in iterative maps but also in certain differential 
equations and even in physical experiments exhibiting period-doubling cascades 
to chaos. Hence the Feigenbaum constant is called a universal constant. 
Figure 14.15 also has fractal structure, one may see similar patterns as you 

zoom into the picture. Fractals will be discussed in detail in Chapter 17 


a b 


Figure 14.17 (a) Iterative paths when p = 3. 8282 and x g = 0. 2. (b) Time series data. 


Another method often used to determine whether or not a system is chaotic is 
to use the Lyapunov exponent . One of the properties of chaos is the sensitivity to 
initial conditions. However, it is known that an orbit on a chaotic attractor for a 
bounded system also returns to all accessible states with equal probability. This 
property is known as ergodicity . Thus iterates return infinitely closely, infinitely 
often to any previous point on the chaotic attractor. The formula below may be 
applied to compute the Lyapunov exponent for iterates in the logistic map. It 
gives an indication as to whether two orbits starting close together diverge or 
converge. 


Definition 3. 
The Lyapunov exponent L computed using the derivative method is defined by 


1 y J 
L = = (FEDI + In foo) +... + In C) 


where f , ‘represents differentiation with respect to x and x 9, X 1, X 2, --- X p are 


successive iterates. The Lyapunov exponent may be computed for a sample of 
points near the attractor to obtain an average Lyapunov exponent . 


Theorem 2. Ifat least one of the average Lyapunov exponents is positive, 
then the system is chaotic; if the average Lyapunov exponent is negative, then 
the orbit is periodic and when the average Lyapunov exponent is zero, a 
bifurcation occurs. 


Table 14.2 lists Lyapunov exponents computed for the logistic map (14.3) for 
several values of the parameter p. Note that there are other methods available for 
determining Lyapunov exponents (see Chapter 8). 


Table 14.2 The Lyapunov exponents computed to 4 decimal places using the first derivative method for 
the logistic map. A total of 50000 iterates was used in each case. 


The numerical results agree quite well with Theorem 2. In fact, the more 
chaotic a system the higher the value of the Lyapunov exponent, as can be seen 
in Table 14.2. In order to find a better approximation of the Lyapunov exponent 
a much larger number of iterates would be required. 

A Python program is given in Section 14.6 for plotting Figure 14.18 showing 
the Lyapunov exponents and a part of the bifurcation diagram for the logistic 
map. 


Logistic map versus Lyapunov exponent 
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Figure 14.18 [Python] The Lyapunov exponent and bifurcation diagram for the logistic map in the range 3 
<u<4. 


Let us return briefly to the tent map (14.1). The Lyapunov exponent of the 
tent map can be found exactly since T(x) = +p for all values of x. Hence 


1 n 
L= lim|- 5 In|T’(,)|| = Inu. 
tin (7D) n| wa) nu 


Problem. Show that for the logistic map with p = 4, the Lyapunov exponent 
is in fact L = In(2). 


14.4 Gaussian and Hénon Maps 


The Gaussian Map. Another type of nonlinear one-dimensional iterative map is 
the Gaussian map G : R — R defined by 


G(x) =e" +B, 


where a and f are constants. The graph of the Gaussian function has a general 


form as depicted in Figure 14.19. The parameters a and f are related to the width 
and height of the Gaussian curve, respectively. 


Figure 14.19 The Gaussian map function. 


Define an iterative map by 
Xn+1 = ie): 


Since there are two parameters associated with this map, one would expect 
the dynamics to be more complicated than for the logistic map. All of the 
features which appear in the logistic map are also present for the Gaussian map. 
However, certain features of the latter map are not exhibited at all by the logistic 
map. Some of these additional phenomena may be described as period bubblings 
, period undoublings , and bistability . These features can appear in the 
bifurcation diagrams. 

Simple numerical and graphical iterations may be carried out as for the tent 
and logistic maps (see the exercises at the end of the chapter). The fixed points 
of period one may be found by solving the iterative equation x „+1 = X ,, for all n, 


which is equivalent to finding the intersection points of the function G(x) with 
the diagonal. It is not difficult to see that there can be one, two, or three 
intersections as shown in Figure 14.20. For certain parameter values it is 
possible to have two stable fixed points of period one. 


The Gaussian map has two points of inflection at y = +——. This implies 
2a 


that period-one behavior can exist for two ranges of the parameters. This in turn 
means that a period-one point can make a transition from being stable to 
unstable and back to stable again, as depicted in Figure 14.21. 


Figure 14.20 Possible intersections of the Gaussian function with the diagonal. 


As the parameter f is increased from f = —1, a fixed point of period one 
becomes unstable and a sequence of period bubbling occurs through period-two, 
period-four, and back to period-two behavior. As the parameter is increased still 
further, the unstable fixed point of period one becomes stable again and a single 
branch appears once more. For higher values of the parameter a, the system can 
display more complex dynamics. An example is shown in Figure 14.22. 

Figure 14.22 displays period-doubling and period-undoubling bifurcations 
and multistability. For example, when f = —1, there are two possible steady-state 
solutions. It is possible for these systems to display bistable phenomena as 
explained in other chapters of the book. The tent and logistic maps cannot 
display bistability. 

The Hénon Map. Consider the two-dimensional iterated map function given 
by 


Xn = L+yn- Ux, (14.5) 
Yntl = PXn, 


Figure 14.21 A bifurcation diagram for the Gaussian map when a = 4 produced using the first iterative 
method. 
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Figure 14.22 Bifurcation diagrams for the Gaussian map when a = 8 produced using the first iterative 
method. In (a) x g = 0 and (b) x g = —1 for each value of p. 


where a > 0 and | 6 | < 1. The map was first discussed by Hénon [6] in 1976 
who used it as a simple model for the Poincaré map of the Lorenz system. The 
Hénon map displays periodicity, mixing, and sensitivity to initial conditions. The 
system can also display hysteresis and bistability can be observed in the 
bifurcation diagrams. Each of these phenomena will now be discussed briefly in 


turn. 
Suppose that the discrete nonlinear system 
Xn+1 = PGs Yn), Yn+1 = On Yn)s 
has a fixed point at (x 4, y 1), where P and Q are at least quadratic in x „ and y 
n Lhe fixed point can be transformed to the origin and the nonlinear terms can 


be discarded after taking a Taylor series expansion . The Jacobian matrix is 
given by 


ðP ÖP 
— Ox dy 
J (x l> Y] ) — oQ 3Q 
Ox oy 


(X11) 


Definition 4. Suppose that the Jacobian has eigenvalues A į and A 5. A fixed 
point is called hyperbolic if both | A į | #1 and | À , | # 1. Ifeither|A,|=1or]A 
>| = 1, then the fixed point is called nonhyperbolic. 


The type of fixed point is determined using arguments similar to those used in 
Chapter 3 In the discrete case, the fixed point is stable as long as | A, | < 1 and | à 


2 | < 1, otherwise the fixed point is unstable. For example, the fixed points of 


period one for the Hénon map can be found by solving the equations given by x 
n+1 =X, andy pi = Y p Simultaneously. Therefore, period-one points satisfy the 


equations 
x=l-ax’+y, y= Bx. 
The solutions are given by 


B- Diylp) + 4e y=B (B-1)+ y1 -8$ + 4a 


E 2a 2a 


Thus the Hénon map has two fixed points of period one if and only if (1 —B)? + 


4a > 0. As a particular example, consider system (14.5) with œ = a and B= 


n 


There are two fixed points of period one given by A = (-4, -2) and p — (3 2 i 
3° 3 


The Jacobian is given by 


—2ax | 
J= | ~ l 
g 0 
The eigenvalues for the fixed point A are A , % —0. 28 and À 5 % 1. 78; therefore, A 


is a saddle point. The eigenvalues for the fixed point B are A , = -1 and à 5 = 0. 


5. Thus this critical point is nonhyperbolic. 

Fix the parameter f = 0. 4 in the Hénon map (14.5). There are points of 
periods one (when a = 0. 2), two (when a = 0. 5), and four (when a = 0. 9), for 
example. The reader can verify these results using the Python program in 
Section 14.6. Some iterative plots are given in Figure 14.23. 
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Figure 14.23 [Python] Iterative plots for system (14.5) when £ = 0. 4 and (a) a = 1 and (b) a= 1. 2. In 
each case the initial point was (0. 1, 0). 


The choice of initial conditions is important in these cases as some orbits are 
unbounded and move off to infinity. One must start with points that are within 
the basin of attraction for this map. Basins of attraction are discussed in other 
chapters of this book. Of course, all of this information can be summarized on a 
bifurcation diagram, and this will be left as an exercise for the reader. There are 
the usual phenomena associated with bifurcation diagrams. However, for the 
Hénon map, different chaotic attractors can exist simultaneously for a range of 
parameter values of a. This system also displays hysteresis for certain parameter 
values. 

To demonstrate the stretching and folding associated with this map, consider 
a set of initial points lying on the square of length two centered at the origin. 
Figure 14.24 shows how the square is stretched and folded after only two 


iterations. This stretching and folding are reminiscent of the Smale horseshoe 
discussed in Chapter 9 

The chaotic attractor formed is an invariant set and has fractal structure. Note 
that det(J) for the Hénon map is equal to | p |. This implies that a small area is 
reduced by a factor of f on each iteration since | p | < 1. 


14.5 Applications 


This section introduces four discrete dynamical systems taken from biology, 
economics, nonlinear optics, and neural networks. The reader can investigate 
these systems via the exercises in Section 14.7. 
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Figure 14.24 Application of the Hénon transformation to a square when a = 1. 2 and £ = 0. 4: (a) initial 
points, (b) first iterates, and (c) second iterates. 


Biology. The average human 70 liter body contains five liters of blood, a 
small amount of which consists of erythrocytes or red blood cells . These cells, 
which are structurally the simplest in the body, can be counted to measure 
hematologic conditions such as anemia . Anemia is any condition resulting in a 
significant decrease in total body erythrocyte mass. The population of red blood 
cells oscillates in a healthy human with the average woman having 4. 2-5. 4 per 
uL, and the average man having 4. 7-6. 1 per pL. A simple blood cell population 
model was investigated by Lasota [9] in 1977. Let c ,, denote the red cell count 


per unit volume in the nth time interval, then 
Cn41 = Cy — da + Pn, 


where d , and p , are the number of cells destroyed and produced in one time 
interval, respectively. In the model considered by Lasota d „ = ac „ and 
Pn = bche™®™, where 0 < a < 1 and b, r, s > 0. Hence 


Cn+1 = (1 — a)cn + bcje*™. (14.6) 


Typical parameters used in the model are b = 1. 1 x 10°, r = 8, and s = 16. 
Clinical examples are cited in the author’s paper [11], where a model is 
investigated in which production and destruction rates vary. 

Economics. The Gross National Product (GNP) measures economic activity 
based on labor and production output within a country. Consider the following 
simple growth model investigated by Day [3] in 1982: 


sk) f (Ky) 


kai = 
Na EF 


where k , is the capital-labor ratio, s is the savings ratio function, f is the per 


capita production function, and A is the natural rate of population growth. In one 
case considered by Day, 


BkP(m — kY 


Shi=O.- f(k) = -Us 


where f, y, m > 0. This leads to the following discrete dynamical system: 


Bkf(m — k,)” 
Kin, = Gea. 7 (14.7) 


wathich can ha thanoaht af ac a hichlw cimnlifiad madal far tha CNP af a 


(Pair eeN ae vagur eae ee oe Gin ain aa eee Wi Ree eee 
country. 

Nonlinear Optics. When modeling the intracavity field of a laser in a bulk 
cavity ring under the assumption that saturable absorption can be ignored, 
Hammel, Jones, and Moloney [5] obtained the following complex one- 
dimensional difference equation relating the field amplitude, say, E „+1, at the (n 


+ 1)st cavity pass to that of a round trip earlier: 


C 
En+1 =A+t BE, exp f (0 _ al š (14.8) 


where © is a phase angle, and A, B, C are all constant. This mapping can also 


be thought of as two dimensional (one-dimensional complex). Splitting E „into 
its real and imaginary parts, equation (14.8) becomes 


Xn41 = A+B Ee cos(@) — Yn sin(@)| 


Yat = B [xn sin(@) + yn cos()], (14.9) 


where g = (4 — —C_). Equations (14.8) and (14.9) are known as Ikeda 
4 1HE, 


mappings . Electromagnetic waves and optical resonators are dealt with in some 
detail in Chapter 16. 

Neural Networks. According to Pasemann and Stollenwerk [15], the 
activity of a recurrent two-neuron module shown in Figure 14.25 at time n is 


given by the vector x „ = (X m» Y n)". The discrete dynamical system used to 
model the neuromodule is given by 


Xntt = A + wy) + W120 (Yn) (14.10) 
Yntl = O2 + W0(Xn), 


W3] 


Figure 14.25 A recurrent two-neuron module with an excitory neuron with activity y p, and a self- 


connected inhibitory neuron with activity x p. 


where o defines the sigmoidal transfer function defining the output of a 
neuron 


. 
3 


a(x) = 
l+e* 


8 , and @ , are the neuron biases; the w j are weights; the index i indicates 


the neuron destination for that weight; and the index j represents the source of 
the signal fed to the neuron. The author and Bandar [12] consider a simple 
neuromodule subject to feedback. Neural networks are dealt with in some detail 
in Chapter 20 


14.6 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


Python Commands Comments 
Rational (1, 2) # Symbolic 1/2. 


# Program_14a: Graphical iteration of the tent map. 
# See Figure 14.7(a). 


from sympy import Rational 
import numpy as np 
import matplotlib.pyplot as plt 


x = Rational(1, 5) # Initial value 
inputs = np.array([]) 
outputs = np.array([]) 
inputs = np.append(inputs, x) 
outputs = np.append(outputs, 0) 
print(x) 
for 1 in range(2, 10): 
inputs = np.append(inputs, x) 
inputs np.append(inputs, x) 


outputs = np.append(outputs, x) 
if x < Rational(1, 2): 
x =2 * x 
elif x > Rational(1, 2): 
x =2-2 * x 
outputs = np.append(outputs, x) 
print(x) 
plt.plot(inputs, outputs, lw=2) 


# Plot the tent function and line y=x. 

= np.linspace(0, 0.5, 100, endpoint=True) 
X2 = np.linspace(0.5, 1, 100, endpoint=True) 
X = np.linspace(0, 1, 200, endpoint=True) 
plt.plot(X1, 2*X1, 7k") 

plt.plot(X2, 2*(1-X2), 'k-') 

plt.plot(X, X, ‘r-’) 

plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’T(x)’, fontsize=15) 
plt.tick_params(labelsize=15) 


>x< 
Hm 
l 


plt.show() 


# Program 14b: Bifurcation diagram of the logistic 
map. 


# See Figures 14.15 and 14.16. 
import numpy as np 
import matplotlib.pyplot as plt 
def f(x, r): 

return r x (1 - x) 
if z == '  main_’: 


= np.linspace(0, 4, 2000) 


ae = np.linspace(3.5, 4, 2000) # For Figure 14 


.16. 


for r in rs: 
xX = 0.1 
for 1 in range(500): 


x = f(x, r) 


for i in range(50): 
x = F(x, r) 
ys.append([r, x]) 


ys = np.array(ys) 

plt.plot(ys[:, O],ys[:, 1], ‘r.’, markersize=0.05) 
plt.xlabel(’$\mu$’, fontsize=15) 

plt.ylabel(’x’, fontsize=15) 
plt.tick_params(labelsize=15) 

plt.show() 


# Program 14c: Lyapunov exponents of the logistic m 
ap. 
# See Figure 14.18. 


import numpy as np 
import matplotlib.pyplot as plt 


Numpoints = 16000; 


result = [] 
lambdas = [] 
maps = [] 


xmin, xmax = 3, 4 
mult=(xmax-xmin)*num_points 
mu_values = np.arange(xmin, xmax, 20/num_points) 


for r in mu_values: 

xX = 0.1 

result = [] 

for t in range(100): 
x=r x (1 - x) 
result.append(np.log(abs(r - 2*r*x))) 

lambdas.append(np.mean(result ) ) 

# Ignore first 100 iterates. 

for t in range(20): 
x=r x (1 - x) 


maps.append(x) 


fig 
ax1 


plt.figure(figsize=(10, 7)) 
fig.add_subplot(1,1,1) 


xticks = np.linspace(xmin, xmax, mult) 


zero = [0] 


* mult 


ax1.plot(xticks, zero, ‘k-’, linewidth=3) 
ax1.plot(xticks, maps, ‘r.’, alpha = 0.3, label=’Lo 


gistic map’ ) 


axi.set_xlabel(’r’) 

axi.plot(muvalues, lambdas, ’b-’, linewidth=1, 

label=’Lyapunov exponent’) 

ax1.grid(’on’ ) 

axi.set_ylim(-1, 1) 

axi.set_xlabel(’$\mu$’, fontsize=15) 

ax1.legend(loc=’best’ ) 

axi.set_title(’Logistic map versus Lyapunov exponen 
t’, fontsize=15) 


plt.show() 


# Program 14d: Iteration of the Henon Map. 
# See Figure 14.23. 


import matplotlib.pyplot as plt 
# Parameters 


a=1.2 
b=0.4 


# Set a=1 to get Figure 14.23(a). 


num_iterations=10000 


def henon(X): 


X, = 
xn = 1 
yn = b 
return 


x 

-a X xX+y 
* xX 

xn, yn 


# Ignore the first 100 iterates. 


XO = [(1 - 
X, Y=[], [ 


b)/2, (1 - b)/2] 


for 1 in range(100): 
xn, yo- henon (X0) 
K y = X+ ae Y + [yn] 
= [xn, 


ieee el [O] 

for i in range(num_iterations): 
xn, yn = henon(X0) 
X, Y =X + [xn], Y + [yn] 
XO = [xn, yn] 


fig, ax = plt.subplots(figsize = (8, 8)) 
ax.scatter(X, Y, color = ‘blue’, s = 0.1) 
plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 

plt.show() 


# Program 14e: Lyapunov exponents of the Henon map. 
# See Exercise 8(C). 


import numpy as np 


a=1.2 

b= 0.4 

Xx =y=o0 
veci = [1, 0] 
vec2 = [0, 1] 


for 1 in range(490): 


xn = 1 - a*x*x + y 

yn = b*x 

x = xn 

y = yn 

J = np.array([[-2*a*x, 1], [b, 0]]) 


vec1 = J.dot(vec1) 
vec2 = J.dot(vec2) 
dotprodi = np.dot(veci, vect) 


dotprod2 = np.dot(veci, vec2) 

vec2 = vec2 - np.multiply((dotprod2/dotprod1), 
veci) 

lengthvi = np.sqrt(dotprod1) 

area = np.multiply(veci[0], vec2[1]) - np.mult 
iply(vec1[1], 

vec2[0]) 

h1 = np.log(lengthv1)/i 
h2 = np.log(area)/i-h1 


print(’h_1 
print(’h_2 


{}’.format(h1) ) 
{}’.format(h2) ) 


h , = 0.33916, h 5 = -1. 25654 


14.7 Exercises 


1. 
Consider the tent map defined by 
2x O<x<3 
T(x) = | 3 
E E Te 
Sketch graphical iterations for the initial conditions (i) x, = L, (ii) 
Xo = a (iii) xo = 2, and (iv) xọ = + Find the points of periods one, two, 
three, and four. Give a formula for the number of points of period N. 
2. (a) 
Let T be the function T: [0, 1] > [0, 1] defined by 


3 
_ J 3% 0<x< 
P a 


Sketch the graphs of T(x), T °(x), and T ?(x). How many points are 
there of periods one, two, and three, respectively? 
(b) 
Let T be the function T: [0, 1] > [0, 1] defined by 


X 


ni= © 
IA IA 
— pl 


A A 


9 
a } a 
EN 2(1 — x) 


Determine the fixed points of periods one, two, and three. 


X 


By editing the Python program given in Section 14.6, plot a bifurcation 
diagram for the tent map. 

Consider the logistic map function defined by f ,(x) = ux(1 — x). Determine 
the functions f ,,(x), f „ °(x), f „ °, and f „ “(x), and plot the graphs when p 
= 4.0. How many points are there of periods one, two, three, and four? 


Consider the iterative equation 
Xn+1 = HUXn(100 = Xa), 


which may be used to model the population of a certain species of insect. 
Given that the population size periodically alternates between two distinct 
values, determine a value of u that would be consistent with this behavior. 
Determine an equation that gives the points of period two for a general p 
value. 


Plot bifurcation diagrams for 


(a) 
the Gaussian map when a = 20 for- 1 <f <1; 


(b) 


the Gaussian map when f = —0. 5 for 0 < a < 20. 


Find the fixed points of periods one and two for the Hénon map given by 


2 Ly 
Xn+1 = Yn Xps  Yn+1 = Xn. 


— -} — 
50 10 
Derive the inverse map. 


(a) 
Show that the Hénon map given by 


2 = Ry 
Xn+1 = |= AX, t Yn, Yatl = Bin 


10. 


where a > 0 and | 6 | < 1 undergoes a bifurcation from period-one to 
period-two behavior exactly when a = 3621 ) for fixed P. 
a 


(b) 
Investigate the bifurcation diagrams for the Hénon map by plotting 
the x „ values as a function of a for p = 0. 4. 

(c) 
Derive the Lyapunov exponents of the Hénon map when a = 1. 2 and 
p=0.4. 


a 

Consider the blood-cell iterative equation (14.6). Assuming that b = 
1. 1 x 10°, r = 8, and s = 16, show that there are (i) two stable and one 
unstable fixed points of period one when a = 0. 2, and (ii) two 
unstable and one stable fixed point of period one when a = 0. 3. 


(b) 
Assume that ø = 0.5, B = 0.3, y= 0.2, A = 0. 2, m = 1 in the economic 


model (14.7). Show that there is a stable fixed point of period one at x 
1,2 = 9. 263 when B = 1, and an unstable fixed point of period one at x 


1,2 = 0. 873 when B = 3. 3. 
(c) 


Show that the inverse map of equation (14.8) is given by 


(En T A) i | CR ) 
-il - ——_—_ ]} . 
(B? T [En zj Al?) 
(d) 


En+1 = —_ BR exp 
Consider the neuromodule model (14.10). Assume that 8 ; = -2, 65 = 
3, W 1, = 720, w 42 = 6, and w 5, = —6. Show that there is one fixed 


point of period one approximately at (—1. 280, 1. 695), and that it is a 
saddle point. 


According to Ahmed et al. [1], an inflation-unemployment model is given 
by 
Uasi = Ui = b(m _ Ty), [p+] = In B (1 — C)f (Un) + f(Un ~~ b(m > 1); 


where f(U) = 8B ,+B»>e ¥, U „and I „are measures of unemployment and 
inflation at time n, respectively, and b, c, f į and fp 5 are constants. Show 


that the system has a unique fixed point of period one at 


e) 


Given that m = 2, B , = -2. 5, P 5 = 20, and c = 0. 18, show that the 
eigenvalues of the Jacobian matrix are given by 


5b . V25b2 — 40bc 


a > = | — — 
a 4 4 


Bibliography 


[1] 


[2] 


[3] 
[4] 


[5] 


[6] 


[7] 


[8] 


[9] 


[10] 


E. Ahmed, A. El-Misiery and H.N. Agiza, On controlling chaos in an inflation-unemployment 
dynamical system, Chaos, Solitons and Fractals, 10 (1999), 1567—1570. 
[MathSciNet][Crossref] 


Z. AlSharawi, J.M. Cushing and S. Elaydi (Editors), Theory and Applications of Difference Equations 
and Discrete Dynamical Systems: ICDEA, Muscat, Oman, May 26-30, 2013, Springer, New York, 
2016. 

[ZzbMATH] 


R.H. Day, Irregular growth cycles, The American Economic Review, 72 (1982), 406-414. 


O. Galor, Discrete Dynamical Systems, Springer, 2010. 
[ZzbMATH] 


S.M. Hammel, C.K.R.T. Jones, and J.V. Maloney, Global dynamical behaviour of the optical field in a 
ring cavity, J. Opt. Soc. Am. B, 2 (1985), 552-564. 
[Crossref] 


M. Hénon, Numerical study of quadratic area-preserving mappings, Quart. Appl. Math., 27 (1969), 
291-311. 
[MathSciNet][Crossref] 


R.A. Holmgrem, A First Course in Discrete Dynamical Systems, 2nd ed., Springer-Verlag, New York, 
2013. 


D. Kaplan and L. Glass, Understanding Nonlinear Dynamics, Springer-Verlag, New York, 1995. 
[Crossref] 


A. Lasota, Ergodic problems in biology, Astérisque, 50 (1977), 239-250. 
[MathSciNet] 


T.Y. Li and J.A. Yorke, Period three implies chaos, Amer. Math. Monthly, 82 (1975), 985-992. 
[MathSciNet][Crossref] 


[11] 


[12] 


[13] 


[14] 


[15] 


[16] 


S. Lynch, Analysis of a blood cell population model, Int. J. of Bifurcation and Chaos, 15 (2005), 
2311-2316. 
[MathSciNet][Crossref] 


S. Lynch and Z.G. Bandar, Bistable neuromodules, Nonlinear Anal. Theory, Meth. & Appl., 63 (2005), 
669-677. 
[Crossref] 


R.M. May, Stability and Complexity in Model Ecosystems, Princeton University Press, Princeton, NJ, 
1974. 


H. Nagashima and Y. Baba, Introduction to Chaos, Physics and Mathematics of Chaotic Phenomena, 
Institute of Physics, London, UK, 1998. 


F. Pasemann and N. Stollenwerk, Attractor switching by neural control of chaotic neurodynamics, 
Computer Neural Systems, 9 (1998), 549-561. 
[Crossref] 


L.A. Soler, J.M. Cushing, S. Elaydi and A.A. Pinto (Editors), Difference Equations, Discrete 
Dynamical Systems and Applications: ICDEA, Barcelona, Spain, July 2012, Springer, New York, 
2016. 

[ZzbMATH] 


© Springer International Publishing AG, part of Springer Nature 2018 
Stephen Lynch, Dynamical Systems with Applications using Python 
https://doi.org/10.1007/978-3-319-78145-7_15 


15. Complex Iterative Maps 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To introduce simple complex iterative maps. 
e To introduce Julia sets, the Mandelbrot set, and Newton fractals. 
e To carry out some analysis on these sets. 


On completion of this chapter, the reader should be able to 


e carry out simple complex iterations; 

e plot Julia sets, the Mandelbrot set, and Newton fractals using simple Python 
programs; 

e determine boundaries of points with low periods; 

e find basins of attraction (or domains of stability). 


It is assumed that the reader is familiar with complex numbers and the Argand 
diagram. Julia sets are defined, and Python is used to plot approximations of 
these sets. 

There are an infinite number of Julia sets associated with one mapping. In 
one particular case, these sets are categorized by plotting a so-called Mandelbrot 
set. A Python program for plotting a color version of the Mandelbrot set is listed. 

Newton fractals are defined and a simple Python program for plotting these 
is listed. 

Applications of complex iterative maps to the real world are presented in 
Chapter 16 and generalizations of Julia and Mandelbrot sets are discussed in [4]. 


15.1 Julia Sets and the Mandelbrot Set 


Ac nao cimnla intraduectian ta ana_dimancinanal nanlinaar camniav itarativwa mance 


M~wa SLLIpLe IIU UVUULCUUL LU VLITTULILITIITOLULIGI LHULHLLHICAL CUILLIPITCA LILCLALU VEO 111g po, 


consider the quadratic map 
Zn+1 = fe(Zn) = a +C, (15.1) 


where z „ and c are complex numbers. Although equation (15.1) is as simple as 


the equation of a real circle, the dynamics displayed are highly complicated. In 
1919, Gaston Julia published a prize-winning lengthy article on certain types of 
conformal complex mappings, the images of which would not appear until the 
advent of computer graphics many years later. Recall that a conformal mapping 
preserves both the size and the sign of angles. 


Definition 1. Consider a complex polynomial mapping of the form z „+1 = f(z 
n). The points that lie on the boundary between points that orbit under f and are 


bounded and those that orbit under f and are unbounded are collectively referred 
to as the Julia set . 


The following properties of a Julia set, say, J, are well known: 


The set J is a repellor. 

The set J is invariant. 

An orbit on J is either periodic or chaotic. 

All unstable periodic points are on J. 

The set J is either wholly connected or wholly disconnected. 
The set J nearly always has fractal structure (see Chapter 17). 


As a gentle introduction to Julia sets and the Mandelbrot set the reader is 
directed to the book entitled “Fractals for the Classroom” [7], and to see the true 
beauty and some detail of the Julia sets and the Mandelbrot set, the author would 
encourage the reader to watch the video [8]. There are also numerous videos on 
YouTube , where the viewer can take a virtual journey into the Mandelbrot set. 

To generate Julia sets, some of the properties listed above are utilized. For 
example, if the set J is a repellor under the forward iterative map (15.1), then the 
Julia set will become an attractor under an inverse mapping. For computational 
reasons, it is best to work with the real and imaginary parts of the complex 
numbers separately. For equation (15.1) it is not difficult to determine the 
inverse map. Now 


me act alll 
Zn+1 = Zp tC, 


and thus 


2 2 — 
Agel = Xn =~ Yn + a, and Yn+1 = 2XnYn + b, 


where Z , =X, + iy „and c =a + ib. To find the inverse map, one must find 
expressions for x „ and y „in terms of x ,,, andy „+4. Now 


J 22 > 
Xn Z Yn = Xnt1 — 4, 
and note that 


2 2\2 2 2A? 2.2 2 2 2 
Uk, + Yn) = (x = Ya) T 4xayi = (Xai _ a) + (Yn+1 = b) . 


2 2 | 
Xn + Yn 7 F (Xn+1 = a) + (Yn+1 = by. 


since x „°? + y „? > 0. Suppose that 


V(Xn+1 — a) + (Yn+1 E py 


Hence 


Xn+1 74 
u = ———————, and v= 
2 2 
Then 
Yn+1 7 b 
Xn =HEVUTYV and Yn = ET (15.2) 
n 


In terms of the computation, there will be a problem if x „ = 0. To overcome 


this difficulty, the following simple algorithm is applied. Suppose that the two 
roots of equation (15.2) are given by x ı + iy ; and x 2 + iy 2. If x, = yVu + v» 


then y, = yu- vy ify >b, or y, = — yu — v ify < b. The other root is then 
given by x, = — yu +v Wdy 2=-Y 1. 


This transformation has a two-valued inverse, and twice as many 
predecessors are generated on each iteration. One of these points is chosen 
randomly in the computer program. Recall that all unstable periodic points are 
on J. It is not difficult to determine the fixed points of period one for mapping 
(15.1). Suppose that z is a fixed point of period one. Then Z „+1 = Z p = Z, and 


which gives two solutions, either 


1+ vl—-4e 1-— vl -—4c 


Zil = — Or Zj2= 
1,1 7 1,2 9 


The stability of these fixed points can be determined in the usual way. Hence 
the fixed point is stable if 


dfe < 
dz 


and it is unstable if 


dfe 


>l. 
dz 


By selecting an unstable fixed point of period one as an initial point, it is 
possible to generate a Julia set using a so-called backward training iterative 
process . 

Julia sets define the border between bounded and unbounded orbits. Suppose 
that the Julia set associated with the point c = a + ib is denoted by J(a, b). As a 
simple example, consider the mapping 


a = a (15.3) 


One of two fixed points of equation (15.3) lies at the origin, say, z *. There is 
also a fixed point at z = 1. Initial points that start wholly inside the circle of 
radius one are attracted to z *. An initial point starting on | z | = 1 will generate 
points that again lie on the unit circle | z | = 1. Initial points starting outside the 
unit circle will be repelled to infinity, since | z | > 1. Therefore, the circle | z | = 1 
defines the Julia set J(0, 0) that is a repellor (points starting near to but not on the 
circle are repelled), invariant (orbits that start on the circle are mapped to other 
points on the unit circle), and wholly connected. The interior of the unit circle 
defines the basin of attraction (or domain of stability ) for the fixed point at z *. 
In other words, any point starting inside the unit circle is attracted to z *. 
Suppose that c = —-0. 5 + 0. 3i, in equation (15.1). Figure 15.1(a) shows a picture 
of the Julia set J(—0. 5, 0. 3) containing 216 points. The Julia set J(—0. 5, 0. 3) 
defines the border between bounded and unbounded orbits. For example, an 


orbit starting inside the set J(—0. 5, 0. 3) at Z ọ = 0 + Oi remains bounded, whereas 
an orbit starting outside the set J(—0. 5, 0. 3) at z = —1 — i, for instance, is 
unbounded. The reader will be asked to demonstrate this in the exercises at the 
end of the chapter. 


Y 
% z 
} 
Ne ral 8 Y 
a 4 ? wk 
y w f 
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Figure 15.1 [Python] Four Julia sets for the mapping (15.1), where J(a, b) denotes the Julia set associated 
with the point c = a + ib: (a) J(-0. 5, 0. 3), (b) J(O, 1), (c) J(-1, 0), and (d) J(0, 1. 1). 


Four of an infinite number of Julia sets are plotted in Figure 15.1. The first three 
are totally connected , but J(0, 1. 1) is totally disconnected. A Python program 
for plotting Julia sets is listed in Section 15.4. Note that there may be regions 
where the Julia set is sparsely populated (see Figure 15.1(c)). You can of course 
increase the number of iterations to try to close these gaps, but other improved 


methods are available. 

Color maps may also be used to plot colorful Julia sets like those plotted in 
Figure 15.2. The Python program for plotting these colorful Julia sets is listed in 
Section 15.4. 


Figure 15.2 [Python] Six colormap Julia sets for mapping (15.1), where J(a, b) denotes the Julia set 
associated with the point c = a + ib: (a) J(-0. 5, 0. 3), (b) J(O, 1. 000001), (c) J(-1, 0), (d) J(0, 1. 1),(e) J(-0. 
123, 0. 745), and (f) J(-0. 1, 0. 65). 


In 1979, Mandelbrot devised a way of distinguishing those Julia sets that are 
wholly connected from those that are wholly disconnected. He used the fact that 
J(a, b) is connected if and only if the orbit generated by z > z ? + c is bounded. 
In this way, it is not difficult to generate the now famous Mandelbrot set. 

Assign a point on a computer screen to a coordinate position c = (a, b), in the 


Argand plane. The point z = 0 + Oi is then iterated under the mapping (15.1) to 
give an orbit 


OF 0RC Oo HEC HCY Cisse: 


If after 50 iterations, the orbit remains bounded (within a circle of radius 4 in 
the program used here), then the point is colored yellow. If the orbit leaves the 
circle of radius 4 after m iterations, where 1 < m < 50, then the point is given a 
shaded color. A Python program that gives Figure 15.3 is listed in Section 15.4. 
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Figure 15.3 [Python] The color Mandelbrot set (central yellow figure) produced using a personal 
computer. 


Unfortunately, Figure 15.3 does no justice to the beauty and intricacy of the 
Mandelbrot set. This figure is a theoretical object that can be generated to an 
infinite amount of detail, and the set is a kind of fractal displaying self-similarity 
in certain parts and scaling behavior. One has to try to imagine a whole new 
universe that can be seen by zooming into the picture. For a video journey into 
the Mandelbrot set, the reader is once more directed to the video [8] and 
YouTube. In 2018, the current record for an animated zoom consisted of 750 
million iterations. The reader can edit Programs 15c listed in Section 15.4 to 
produce their own zoom-in figures. 

It has been found that this remarkable figure is a universal “constant” much 
like the Feigenbaum number introduced in Chapter 14 Some simple properties of 
the Mandelbrot set will be investigated in the next section. 


15.2 Boundaries of Periodic Orbits 


For the Mandelbrot set, the fixed points of period one may be found by solving 
the equation Z „+1 = Z , for all n, or equivalently, 


flZ =o +0 =z, 
which is a quadratic equation of the form 
ł-z+c=0. (15.4) 


The solutions occur at 


1+ Vl-4c 1- vyl-4c 


z1 = —— and 2. = ——— 
1,1 5 1,2 5 
where Z 4 ; is the first fixed point of period one and z ; 5 is the second fixed point 


of period one using the notation introduced in Chapter 14 As with other discrete 
systems, the stability of each period-one point is determined from the derivative 
of the map at the point. Now 


df, 


dz 


i0 


=2z=re, (15.5) 


where r > 0 and 0 < 0 < 27. Substituting from equation (15.5), equation 
(15.4) then becomes 


The solution for c is 


(15.6) 


One of the fixed points, say, z 1,1» İS stable as long as 


— <i: 
dz 


(Z1,1) 


Therefore, using equation (15.5), the boundary of the points of period one is 
given by 


= [27 ,)/=r=1 


$ id 
ae ALA 


in this particular case. Let c = x + iy. Then from equation (15.6), the boundary is 
given by the following parametric equations: 


1 1 1 1 
g= 5 cos 6 — 7 cos(26), y= 5 sin 6 — ri sin(26). 


The parametric curve is plotted in Figure 15.4 and forms a cardioid that lies 
at the heart of the Mandelbrot set. 


0.5 
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Figure 15.4 The boundary of fixed points of period one for the Mandelbrot set. 


Using similar arguments to those above, it is not difficult to extend the 
analysis to determine the boundary for the fixed points of period two. Fixed 
points of period two satisfy the equation Z „+> = Z , for all n. Therefore, 


RO= to +c, 
or, equivalently, 
Ź+2cf -z+ +c=0. (15.7) 


However, since points of period one repeat on every second iterate, the 
points Z 4 ı and Z 4 » satisfy equation (15.7). Therefore, equation (15.7) factorizes 


into 
(Z -z+ +z+e+1)=0. 
Hence the fixed points of period two satisfy the quadratic equation 
zerre l=, (15.8) 


which has roots at 


N 
z Period one 
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Figure 15.5 The boundary of fixed points of periods one and two for the Mandelbrot set. 
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Figure 15.6 The Mandelbrot set for the mapping Z p+1 =Z n 2_ oy ntc. 


Once more the stability of each critical point is determined from the 
derivative of the map at the point, now 


df? 
se = 4z? + 4cz = Az(z* +c). 
Kj 
Thus, 
df? 
7 D| = 4 + 4c, 
and the boundary is given by 
1 
le + 1| = —. 
4 


The parametric curve is plotted in Figure 15.5 and forms a circle centered at 
(-1, 0) of radius 14 in the Argand plane. This circle forms the “head” of the 


Mandelbrot set, sometimes referred to as the potato man. 
The Mandelbrot set for the nonlinear complex iterative map Z „41 =Z p? — 2Z ,+ 
c is plotted in Figure 15.6. 


Figure 15.7 [Python] Julia set for the rational function associated with Newton’s method for the complex 
function f(z) = z 3-1, 


15.3 The Newton Fractal 


It is well known that in numerical analysis [5], Newton’s method, or the 
Newton-Raphson method can be used to find the roots of the equation f(z) = 0 
using the iterative formula 
_ fC) 

F'n) 


Zn+1 = Zn 


Definition 2. A Newton fractal is the Julia set of the meromorphic function 


Zn+1 = f (Zn), and shows that the numerical method can be very sensitive to its 


choice of initial starting point. 


A Julia set for the rational function associated with Newton’s method for the 
function f(z) = z ? - 1 is plotted in Figure 15.7. The boundary between the 
different basins of attraction form a Julia set. Fractals are discussed in more 
detail in Chapter 17. 

Note that other fractals may be constructed using different numerical 
techniques such as the Halley, Householder, Secant, and Schröder methods [10]. 

Mandelbrot and Hudson [6] provide a fractal view of the stockmarkets, and 
Chapter 16 illustrates how nonlinear complex iterative maps are being applied in 
physical applications when modeling lasers and the propagation of light through 
optical fibers. 


15.4 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


complex(x,y) |# The complex number x+iy. 


fim | Imaginary part of complex number. 
rest Real part of complex number. 


# Program 15a: Plot points for the Julia set. 

# See Figure 15.1. 

from matplotlib import pyplot as plt import random 
from sympy import sqrt, re, im, I 


# Parameters 

a, b=0, 1.1 # To plot J(a,b). 
k=15 

Num_iterations = 2**k 


def julia(X): 
X, y=X 
x1, yl = xX, y 


u = sqrt((x1-a)**2 + (y1-b)**2) / 2 
v = (x-a) / 2 
ul = sqrt(u + v) 
vi = sqrt(u - v) 
xn, yn = ul, vi 
if yi<b: 
yn = -yn 
if random.random() < 0.5: xn, yn = -u1, -yn 


return (xn, yn) 


x1 = (re(0.5 + sqrt(0.25 - (a + b*I)))).expand(comp 
lex=True) 
yi = (im(0.5 + sqrt(0.25 - (a + b*I)))).expand(complex 
=True) is_unstable = 2 abs(x1 + yil) 
print(is_unstable) 


XO = [x1, y1] 
X, Y= [], [] 
for i in range(num_iterations): 
xn, yn = julia(X0) 
- y =X + [xn], Y + [yn] 
= [xn, y 


fig, ax = plt.subplots(figsize=(8, 8)) 
ax.scatter(X, Y, color="blue’, s=0.15) ax.axis(’off’) 
plt.show() 


# Program 15b: Colormap of a Julia set. 

# See Figure 15.2. 

import numpy as np 

import matplotlib.pyplot as plt 

import matplotlib.cm as cm # Use a colorma 


# Set image dimensions. 
im_w, im_h = 500, 500 
c = complex(-0.1, 0.65) # To plot J(a,b) 


max_abs_z = 10 


max_iter = 1000 


xmin, xmax = -2, 2 
xrange = xmax - xmin 
ymin, ymax = -2, 2 


yrange = ymax - ymin 


julia = np.zeros((im_w, im_h)) 
for re_z in range(im_w): 
for im_y in range(im_h): 
nit = 0 
# Map pixel position to a point in the plan 
e z = complex(re_z / im_w * xrange+ xmin, 
im_y / im_h * yrange + ymin) # Do the iterations 
while abs(z) <= max_abs_z and nit < max_ite 
r: Zz = Z**2 eG 


nit += 1 
ratio = nit / max_iter 
julia[- 
im_y, re_z] = ratio # Set axes to Re(z) and Im(z). 


fig, ax = plt.subplots() 

ax.axis(’off’ ) 

ax.imshow(julia, interpolation=’nearest’, cmap=cm.h 
ot) plt.show( ) 


# Program 15c: The Mandelbrot set. 
# See Figure 15.3. 


import numpy as np 

import matplotlib.pyplot as plt 

xmin, xmax = -2.5, 1 

ymin, ymax = -1.5, 1.5 

xrange, yrange = xmax-xmin, ymax-ymin; 


def mandelbrot(h, w, Max_it=50): 
y, X = np.ogrid[ ymin:ymax:h*1j, xmin:xmax:w*1j ] 
c = xty*1j 
Z=C 
div_iter = max_iter + np.zeros(z.shape, dtype= 


int) 


for i in range(max_iter): 
Z=2z**2 + C 
div_test = z*np.conj(z) > 2**2 
div_num = div_test & (div_iter == max_iter 
) div_iter[div_num] = i 
z[div_test] = 2 


return div_iter # Number of it 
erations to diverge. 


scale=1000 # Amount of de 
tail in the set. 


# Set the tick labels to the Argand plane. 

fig, ax = plt.subplots() 

ax.imshow(mandelbrot(scale, scale) ) 
xtick_labels = np.linspace(xmin, xmax, xrange / 0.5) 
ax.set_xticks([(x- 
xmin) / xrange * scale for x in xtick_labels] ) 
ax.set_xticklabels([’{:.1f}’.format(xtick) for xtick i 
n xtick_labels]) 
ytick_labels = np.linspace(ymin, ymax, yrange / 0.5) 
ax.set_yticks([- 
(ytymin) / yrange * scale for y in ytick_labels] ) 
ax.set_yticklabels([’{:.1f}’.format(ytick) for ytick i 
n ytick_labels]) plt.show() 


# Program 15d: Plotting a Newton fractal. 
# See Figure 15.7. 


from PIL import Image 
width = height = 512 
image = Image.new(’RGB’, (width, height) ) 


xmin, xmax 
ymin, ymax 


St iby AS 
= 1,5 455 


1 


max_iter = 20 


h = 1e-6 # Step size 
eps = 1e-3 # Maximum error 


def f(z): 
return z**3 - 1.0 # Complex function. 


# Draw the fractal. 
for y in range(height): 
zy = y * (ymax - ymin) / (height - 1) + ymin 
for x in range(width): 
ZX = X * (xmax - xmin) / (width - 1) + xmin 
Z = complex(zx, zy) 
for 1 in range(max_iter): 
# Complex numerical derivative. 
dz = (f(z + complex(h, h)) - f(z)) 7 co 
mplex(h, h) zO = z - f(z) / dz # Newton iteration. 
if abs(zO - z) < eps: # Stop when close 
enough to any root. 
break 
Z = Z0 
image.putpixel((x, y), (i%4 64, i%8 3 
2, i% 16 * 16)) 


image.save(’Newton_Fractal.png’, ’PNG’) 
image. show( ) 


15.5 Exercises 

1. Consider the Julia set given in Figure 15.1(a). Take the mapping Z „1 =Z pn 
2 + c, where c = -0.5 +0. 3i. 
(a) Iterate the initial point z ọ = 0 + Oi for 500 iterations and list the final 


100. Increase the number of iterations, what can you deduce about the 
orbit? 


(b) 


Iterate the initial point z ọ = —1 — i and list z 4 to Z 4ọ. What can you deduce 
about this orbit? 


Given that c = —1 + i, determine the fixed points of periods one and two for 
the mapping Z p1 =Z n° +c. 


3. 
Consider equation (15.1); plot the Julia sets J(0, 0), J(—0. 5, 0), J(-0. 7, 0), 
and J(—2, 0). 
4. 
Compute the fixed points of period one for the complex mapping 
zo pl Izal? 
Zne 
E = 24+— 
1+1 10 
5. 
Determine the boundaries of points of periods one and two for the mapping 
miat 
6. 
Plot the Mandelbrot set for the mapping 
a Seen 
7. 
Determine the fixed points of periods one and two for the mapping Z „+1 = Z 
a 
8. 
Modify the Python program in Section 15.4 to plot a Mandelbrot set for the 
mappings (i) Z „1 = Z p + c and (ii) Z pip = Zp +C. 
9. 
Determine the periods of the points (i) c = —1. 3 and (ii) c = —0. 1 + 0. 8i for 
the mapping Z p1 =Z n° +c. 
10. 
Plot a Newton fractal (of the same format to that shown in Figure 15.6) for 
the function f(z) =z? — 2z + 2. 
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16. Electromagnetic Waves and Optical 
Resonators 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


To introduce some theory of electromagnetic waves. 

To introduce optical bistability and show some related devices. 

To discuss possible future applications. 

To apply some of the theory of nonlinear dynamical systems to model a real 
physical system. 


On completion of this chapter, the reader should be able to 


e understand the basic theory of Maxwell’s equations; 

e derive the equations to model a nonlinear simple fiber ring (SFR) resonator; 

e investigate some of the dynamics displayed by these devices and plot chaotic 
attractors; 

e use a linear stability analysis to predict regions of instability and bistability; 

e plot bifurcation diagrams using the first and second iterative methods; 

e compare the results from four different methods of analysis. 


As an introduction to optics, electromagnetic waves are discussed via 
Maxwell’s equations. 

The reader is briefly introduced to a range of bistable optical resonators 
including the nonlinear Fabry-Perot interferometer, the cavity ring, the SFR, the 
double-coupler fiber ring, the fiber double-ring, and a nonlinear optical loop 
mirror (NOLM) with feedback. All of these devices can display hysteresis and 
all can be affected by instabilities. Possible applications are discussed in the 
physical world. 


T Ben ees) Se LAS ae eee ee Se BS ee I ee IE ce ee a E a 


Linear StaD1llty aNalysis 1s applied to the nontinear SrK resonator. 1ne 
analysis gives intervals where the system is bistable and unstable but does not 
give any information on the dynamics involved in these regions. To use optical 
resonators as bistable devices, the bistable region must be isolated from any 
instabilities. To supplement the linear stability analysis, iterative methods are 
used to plot bifurcation diagrams. 

For a small range of parameter values, the resonator can be used as a bistable 
device. Investigations are carried out to see how the bistable region is affected 
by the linear phase shift due to propagation of the electric field through the fiber 
loop. 

For Python programming in optics, the reader is directed to [12]. 


16.1 Maxwell’s Equations and Electromagnetic 


Waves 


This section is intended to give the reader a simple general introduction to 
optics. Most undergraduate physics textbooks discuss Maxwell’s 
electromagnetic equations in some detail. The aim of this section is to list the 
equations and show that Maxwell’s equations can be expressed as wave 
equations . Maxwell was able to show conclusively that just four equations 
could be used to interpret and explain a great deal of electromagnetic 
phenomena. 

The four equations, collectively referred to as Maxwell’s equations, did not 
originate entirely with him but with Ampère, Coulomb, Faraday, Gauss, and 
others. First, consider Faraday’s law of induction , which describes how electric 
fields are produced from changing magnetic fields. This equation can be written 


as 
Od 

E.dr = -— 

$ = ar 


where E is the electric field strength , r is a spatial vector , and @ is the magnetic 
flux . This equation may be written as 


P Ear=-2 || Bas, 
C Ot J Js 


where B is a magnetic field vector . Applying Stokes’s theorem, 


f| vreas=-2 f| Bas 
S Ot J Js 


OB 
A 
ar (16.1) 


which is the point form of Faraday’s law of induction. 
Ampere’s law describes the production of magnetic fields by electric 


currents. Now 
P Hear = || Jas. 
G S 


where H is another magnetic field vector (B = u H) and J is the current 
density . By Stokes’s theorem 


h H.a- || van.as= ff sas. 


VAH=J. 
Maxwell modified this equation by adding the time rate of change of the electric 


flux density (electric displacement ) to obtain 


oD 
VAH= — 
e (16.2) 


Therefore, 


Therefore, 


where D is the electric displacement vector . 

Gauss’s law for electricity describes the electric field for electric charges, 
and Gauss’s law for magnetism shows that magnetic field lines are continuous 
without end. The equations are 


(16.3) 
where p is the charge density and € 9 is the permittivity of free space (a 


vacuum ), and 


(16 A) 


V.B=0. eis 


In using Maxwell’s equations, (16.1) to (16.4), above and solving problems 
in electromagnetism, the three so-called constitutive relations are also used. 
These are 


B = uĦ = u,uoH; D=cE=6eqE and J=cE, 
where u „ H o are the relative permeabilities of a material and free space, 


respectively; € ,, € ọ are the relative permittivities of a material and free space, 


respectively; and o is conductivity . 
If E and H are sinusoidally varying functions of time, then in a region of free 
space, Maxwells’ equations become 


V.E=0; V.H=0; VAE+iouwH=0 and VAH-iwgE = 0. 


The wave equations are obtained by taking the curls of the last two equations; 
thus 


VE+ &uwE=0 and V°H+ uw H = 0, 


where œ is the angular frequency of the wave . These differential equations 
model an unattenuated wave traveling with velocity 
1 
V&H 
where c is the speed of light in a vacuum. The field equation 
E(r, t) = Eo exp [i(wt — kr)], 


satisfies the wave equation, where | k | = 27A is the modulus of the wave vector 
and A is the wavelength of the wave. The remarkable conclusion drawn by 
Maxwell is that light is an electromagnetic wave and that its properties can all be 
deduced from his equations. The electric fields propagating through an optical 
fiber loop will be investigated in this chapter. 

Similar equations are used to model the propagation of light waves through 
different media including a dielectric (a nonconducting material whose 
properties are isotropic); see the next section. In applications to nonlinear optics, 
the Maxwell-Debye or Maxwell-Bloch equations are usually used. Interested 
readers are referred to Chapter 12, [9, 16], and the research papers listed at the 
end of this chapter. 


16.2 Historical Background 


In recent years, there has been a great deal of interest in optical bistability 
because of its potential applications in high-speed all-optical signal processing 
and all-optical computing. Indeed, in 1984 Smith [22] published an article in 
Nature with the enthralling title “Towards the Optical Computer,” and in 1999, 
Matthews [18] reported on work carried out by A. Wixforth and his group on the 
possibility of optical memories . Bistable devices can be used as logic gates , 
memory devices , switches , and differential amplifiers . The electronic 
components used nowadays can interfere with one another, need wires to guide 
the electronic signals, and carry information relatively slowly. Using light 
beams, it is possible to connect all-optical components. There is no interference; 
lenses and mirrors can be used to communicate thousands of channels of 
information in parallel; the information-carrying capacity—the bandwidth —is 
enormous; and there is nothing faster than the speed of light in the known 
universe. 

In 1969, Szöke et al. [25] proposed the principle of optical bistability and 
suggested that optical devices could be superior to their electronic counterparts. 
The two essential ingredients for bistability are nonlinearity and feedback . For 
optical hysteresis, nonlinearity is provided by the medium as a refractive (or 
dispersive ) nonlinearity or as an absorptive nonlinearity , or as both. Refractive 
nonlinearities alone will be considered in this chapter. The feedback is 
introduced through mirrors or fiber loops or by the use of an electronic circuit. 
The bistable optical effect was first observed in sodium vapor in 1976 at Bell 
Laboratories, and a theoretical explanation was provided by Felber and 
Marburger [7] in the same year. Nonlinearity was due to the Kerr effect (see 
Section 16.3), which modulated the refractive index of the medium. 

Early experimental apparatus for producing optical bistability consisted of 
hybrid devices that contained both electronic and optical components. Materials 
used included indium antimonide (InSb), gallium arsenide (GaAs), and tellurium 
(Te). By 1979, micron-sized optical resonators had been constructed. A 
fundamental model of the nonlinear Fabry-Perot interferometer is shown in 
Figure 16.1. 


< 


Nonlinear 


medium 


Figure 16.1 A Fabry-Perot resonator ; I, R, and T stand for incident , reflected , and transmitted 
intensities, respectively. 


An excellent introduction to nonlinearity in fiber optics is provided by the 
textbook of Agrawal [1]. Applications in nonlinear fiber optics are presented in 
[2] and [21]. In recent years, there has been the development of microfibers and 
resonators composed of these types of fiber [14]. Now the fiber diameter has 
been reduced down to the nanoscale and resonator ring lengths are of the order 
of millimeters. Because of the narrowness of the fiber diameter a significant 
proportion of the guided electric field can extend beyond the optical fiber core, 
known as the evanescent field, which makes them of interest in optical sensing 
applications. 

A block diagram of the first electro-optic device is shown in Figure 16.2 and 
was constructed by Smith and Turner in 1977 [23]. Nonlinearity is induced by 
the Fabry-Perot interferometer and a He-Ne (helium-neon) laser is used at 
6328\r{A}. A bistable region is observed for a small range of parameter values. 
An isolated bistable region is shown in Figure 16.4(a). For input values between 
approximately 4 and 5 units there are two possible output values. The output is 
dependent upon the history of the system, that is, whether the input power is 
increasing or decreasing. 


Amplifier 


Detector 


Fabry—Perot 
Resonator 


Beamsplitter 


Figure 16.2 The first electro-optic device to display bistability. 


In theoretical studies, Ikeda, Daido, and Akimoto [10] showed that optical 
circuits exhibiting bistable behavior can also contain temporal instabilities under 
certain conditions. The cavity ring (CR) resonator, first investigated by Ikeda, 
consists of a ring cavity comprising four mirrors that provide the feedback and 
containing a nonlinear dielectric material (see Figure 16.3). Light circulates 
around the cavity in one direction and the medium induces a nonlinear phase 


shift dependent on the intensity of the light. Mirrors M , and M , are partially 
reflective, while mirrors M 3 and M , are 100% reflective. 


M, Nonlinear Passive M, 
Medium 


Figure 16.3 The CR resonator containing a nonlinear dielectric medium. 


Possible bifurcation diagrams for this device are shown in Figure 16.4. In 
Figure 16.4(a), the bistable region is isolated from any instabilities, but in 
Figure 16.4(b), instabilities have encroached upon the bistable cycle. These 
figures are similar to those that would be seen if the CR were connected to an 
oscilloscope. However, most of the dynamics are lost; mathematically it is best 
to plot bifurcation diagrams using points alone. The length L is different in the 
two cases and hence so is the cavity round-trip time (the time it takes light to 
complete one loop in the cavity). 
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Figure 16.4 Possible bifurcation diagrams for the CR resonator : (a) an isolated bistable region and (b) 
instabilities within the bistable region. S represents stable behavior, P is period undoubling, and C stands for 
chaos . 


In recent years, there has been intense research activity in the field of fiber 
optics. Many school physics textbooks now provide an excellent introduction to 
the subject, and [4] provides an introduction to nonlinear optics. The interest in 
this chapter, however, lies solely in the application to all-optical bistability. A 
block diagram of the SFR resonator is shown in Figure 16.5. It has recently been 
shown that the dynamics of this device are the same as those for the CR 
resonator (over a limited range of initial time) apart from a scaling. The first all- 
optical experiment was carried out using a single-mode fiber in a simple loop 
arrangement, the fiber acting as the nonlinear medium [19]. In mathematical 
models, the input electric field is given as 


E in) = Ee, 


where ¢ ; represents a complex amplitude (which may contain phase 
information) and æ is the circular frequency of the light . 


in Fiber coupler out 


Figure 16.5 A schematic of the SFR resonator. The input electric field is E ;, and the output electric field 


isE out: 


In experimental setups, for example, the light source could be a Q-switched 
YAG laser operating at 1. 06 pm. The optical fiber is made of fused silica and is 
assumed to be lossless. 

Analysis of the SFR resonator will be discussed in more detail in the next 
section, and the stability of the device will be investigated in Sections 16.5 
and 16.6. 

The double-coupler fiber ring resonator was investigated by Li and Ogusu 
[13] in 1998 (see Figure 16.6). It was found that there was a similarity between 
the dynamics displayed by this device and the Fabry-Perot resonator in terms of 
transmission and reflection bistability. It is possible to generate both clockwise 
and counterclockwise hysteresis loops using this device. An example of a 
counterclockwise bistable cycle is given in Figure 16.4(a). The reader will be 
asked to carry out some mathematical analysis for this device in the exercises at 
the end of the chapter (Section 16.8). 
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Figure 16.6 The double-coupler fiber ring resonator: E jy is the input field amplitude, E out R is the 


reflected output, and E out T is the transmitted output. 


In 1994, Ja [11] presented a theoretical study of an optical fiber double-ring 
resonator, as shown in Figure 16.7. Ja predicted multiple bistability of the output 
intensity using the Kerr effect. However, instabilities were not discussed. It was 
proposed that this type of device could be used in new computer logic systems 
where more than two logic states are required. In principle, it is possible to link a 
number of loops of fiber, but instabilities are expected to cause some problems. 
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Figure 16.7 A fiber double-ring resonator with two couplers. 


The nonlinear optical loop mirror (NOLM) with feedback , [6, 14], and [24], 
has been one of the most novel devices for demonstrating a wide range of all- 
optical processing functions including optical logic. The device is shown in 
Figure 16.8. Note that the beams of light are counterpropagating in the large 
loop but not in the feedback section and that there are three couplers. 
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Figure 16.8 A schematic of a NOLM with feedback. 


All of the devices discussed thus far can display bistability and instability 
leading to chaos. In order to understand some of these dvnamics. the SFR 
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resonator will now be discussed in some detail. 


16.3 The Nonlinear SFR Resonator 


Consider the all-optical fiber resonator as depicted in Figure 16.9 and define the 
slowly varying complex electric fields as indicated. 

Note that the power P and intensity I are related to the electric field in the 
following way: 


P œ I œ |E}. 


If the electric field crosses the coupler , then a phase shift is induced, which is 
represented by a multiplication by i in the equations. Assume that there is no loss 
at the coupler. Then across the coupler the complex field amplitudes satisfy the 
following equations: 


E; E 


in K:1-kK out 


Figure 16.9 The SFR resonator. The electric field entering the fiber ring is labeled E 4 and the electric 
field leaving the fiber ring is labeled E 5. The coupler splits the power intensity in the ratio x: 1 -K. 


E; = VKE +ivVl1 —KkEn (16.5) 
and 
Eout = VkKEin ti V1 — KEd, (16.6) 


where x is the power-splitting ratio at the coupler. Consider the propagation 
from E ; to E 5. Then 


(1G 7\ 


\1u-/) 


E> = Eie”, 


where the total loss in the fiber is negligible (typically about 0.2 dB/km) and 
b= $L + Ont. 
The linear phase shift is  ,, and the nonlinear phase shift due to propagation 
is given by 
2nroL 


El, 
AoAett 


ONL = 


where A 9 is the wavelength of propagating light in a vacuum, A or is the 
effective core area of the fiber , L is the length of the fiber loop, and r 5 is the 
nonlinear refractive index coefficient of the fiber. It is well known that when the 
optical intensity is large enough, the constant r 5 satisfies the equation 

ror 


0 9) P 
Eil? = ro + n—, 
270 Aeff 


r=rotml=rt 


where r is the refractive index of the fiber, r 9 is the linear value, I is the 
instantaneous optical intensity, and P is the power. If the nonlinearity of the fiber 
is represented by this equation, then the fiber is said to be of Kerr type . In most 
applications, it is assumed that the response time of the Kerr effect is much less 
than the time taken for light to circulate once in the loop. 

Substitute (16.7) into equations (16.5) and (16.6). Simplify to obtain 


EO = i V1 —xE,(t) + VKE\(t — tpe” T, 


where ;, = 4 is the time taken for the light to complete one loop, r is the 
C 


refractive index, and c is the velocity of light in a vacuum. Note that this is an 
iterative formula for the electric field amplitude inside the ring. Take time steps 
of length equal to t p. This expression can be written more conveniently as an 


iterative equation of the form 


— 


Trobe P+ 16.8 
ApAef n L ? ( . ) 


En+1 = A+ BE, exp qi 


where 4 =;V] —x E B= x, and E ; is the electric field amplitude at the 


jth circulation around the fiber loop. Typical fiber parameters chosen for this 
system are À ọ = 1. 55 x 1076 m, r » = 3. 2 x 10°70 m? WA „pẹ = 30 um?, and L 
= 80 m. 

Equation (16.8) may be scaled without loss of generality to the simplified 
equation 


En+1 = A + BE, exp En? + 61)| ] (16.9) 


Some of the dynamics of equation (16.9) will be discussed in the next section. 


16.4 Chaotic Attractors and Bistability 
Split equation (16.9) into its real and imaginary parts by setting E „=X p + İY p» 
and set @ ; = 0. The equivalent real two-dimensional system is given by 


Xnt1 = A+B (x cos |En? — yn sin En?) 


(16.10) 
Yn+1 = B (xn sin (Enl + Yn COS jaf) > 


» 


where | B | < 1. This system is one version of the so-called Ikeda map . As with 
the Hénon map, introduced in Chapter 14, the Ikeda map can have fixed points 
of all periods. In this particular case, system (16.10) can have many fixed points 
of period one depending on the parameter values A and B. 


Example 1. | Determine and classify the fixed points of period one for system 
(16.10) when B = 0. 15 and (i) A = 1; 
(ii) A = 2. 2. 


Solution. The fixed points of period one satisfy the simultaneous equations 
x= A+ Bx cos(x? + y) — By sin(x? + y?) 
and 
T 2 2 2 
y = Bxsin(x’ + y^) + By cos(x + y^). 


(i) When A = 1 and B = 0. 15, there is one solution at x 4 * 1. 048, y 4 ı * 0. 151. 
The solution is given graphically in Figure 16.10(a). To classify the critical point 
P * = (X 11y 1,1), consider the Jacobian matrix 


oP aP 
2 x Oy 
TERA 


The eigenvalues of the Jacobian matrix at P * are À , % —0. 086 + 0. 123i and 
À > = —0. 086 - 0. 123i. Therefore, P * is a stable fixed point of period one. 

(ii) When A = 2. 2 and B = 0. 15, there are three points of period one, as the 
graphs in Figure 16.10(b) indicate. The fixed points occur approximately at the 
points U = (2. 562, 0. 131), M = (2. 134, -0. 317), and L = (1. 968, —0. 185). 
Using the Jacobian matrix, the eigenvalues for U are A 4 5 = —0. 145 + 0. 039i; the 
eigenvalues for M are A 4 = 1. 360, A 5 = 0. 017; and the eigenvalues for L are A , 
= 0.555, A, = 0.041. 
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Figure 16.10 [Python] The fixed points of period one are determined by the intersections of the two 


curves, x = A + 0. 15xcos(x 2 +y 2 — 0. 15ysin(x 2 ty 2) and y = 0. 15xsin(x 2 +y 2 + 0. 15ycos(x 2 +y 2), 
(a) A= 1 and (b) A = 2. 2. Note in case (b) that the small closed curve and the vertical curve form one 
solution set. 


Therefore, U and L are stable fixed points of period one, while M is an 
unstable fixed point of period one. These three points are located within a 
bistable region of the bifurcation diagram given later in this chapter. The point U 
lies on the upper branch of the hysteresis loop and the point L lies on the lower 
branch. Since M is unstable it does not appear in the bifurcation diagram but is 
located between U and L. 

As the parameter A changes, the number of fixed points and the dynamics of 
the system change. For example, when A = 1, there is one fixed point of period 


one; when A = 2. 2, there are two stable fixed points of period one and one 
unstable fixed point of period one; when A = 2. 4, there are two stable fixed 
points of period two. As A increases the system displays chaotic behavior (see 
Example 2). All of the information can be summarized on a bifurcation diagram 
that will be shown later in this chapter. 


Example 2. Plot iterative maps for system (16.10) when B = 0. 15 and (a) A = 
3; 
(b) A = 10. 


Solution. Two chaotic attractors for system (16.10) are shown in Figure 16.11. 
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Figure 16.11 [Python] The chaotic attractors when (a) A = 5 (5000 iterates) and (b) A = 10 (5000 iterates). 


Theorem 1. The circle of radius oe centered at A is invariant for system ( 
-B 


16.10 ). 


Proof. 
Suppose that a general initial point in the Argand diagram is taken to be E „; then 


the first iterate is given by 
sigs 42. 
Ens) = A+ BE, ™". 


The second iterate can be written as 


aoo 2 Pe S T 2 
Eni. = A + BEp16"™rl = A + B(A + BE," jerm . 
Thus 
a 212 EE N 
E2 =À + ABellEnil 4 B? EeP”! HEn+11). 
Using a similar argument, the third iterate is 
y = ilEn+1l? 2 illEn PHE 1) Epal 
F443 =A+t+ B(A+ABe + B*E,e e . 
Therefore, 
En+3 — A + A Be! En? + AB2eilEntiP +lEnv2P) + B? Ee En  HEna P +E nal), 
A general expression for the Nth iterate E „+y is not difficult to formulate. Hence 
Eny = A+ ABellEnn-i? 4 AB?eiEnn- HEN 4 
z . o N-1 2 N oN- ] 2 
+ABN" exp (i Daj] [Ezel ) + BYE, exp (i 2 |En+jl ) . 
As N > », BN > 0, since 0 < B< 1. Set R} =| E py- |°. Then 
|EnN — Al = |ABe'*! he AB el Rita) She os, abe Ap gee), 
Since |z,+Z5+...+Zm|<|[Z1|+|Zo|+...+|z_,]and|e®| =1, 
|En = Al < |AB]+|AB*|+...+ ABY]. 


This forms an infinite geometric series as N —> œ. Therefore 
|AB| 


En = Al = : 
| +N | 1_-B 


The disc given by | E - A | = AB(1 - B) is positively invariant for system 
(16.10). The invariant disks in two cases are easily identified in Figures 16.11(a) 
and (b). 


16.5 Linear Stability Analysis 


To investigate the stability of the nonlinear SFR resonator, a linear stability 
analysis (see Chapter 2) will be applied. A first-order perturbative scheme is 
used to predict the values of a parameter where the stationary solutions become 
unstable. Briefly, a small perturbation is added to a stable solution and a Taylor 
series expansion is carried out, the nonlinear terms are ignored, and a linear 
stability analysis is applied. 

It was shown in Section 16.3 that the following simplified complex iterative 
equation can be used to model the electric field in the fiber ring: 


En+1 =Å+ BE, exp |i (Enl m 61)| ; (16.11) 


where E „is the slowly varying field amplitude; 4 = ;./] — x Evy? is related to 
the input; B = yx, where x is the power coupling ratio; and Ọ z is the linear 


phase shift suffered by the electric field as it propagates through the fiber loop. 
To simplify the linear stability analysis, there is assumed to be no loss at the 
coupler and the phase shift @ ; is set to zero. The effect of introducing a linear 


phase shift will be discussed later in this chapter. 
Suppose that E < is a stable solution of the iterative equation (16.11). Then 


E; = A+ BEgell®s. 
Therefore, 
A = Es |1 - B (cos(lEs Ô) + isin|Es/)]. 
Using the relation | z |? = zz *, where z * is the conjugate of z, 


IA? = (Es 1 — B(cos(|Es/°) + isin Es? 
(E; |1 - B(cos(\Es)?) - isin Es? 


)x 
i: 


Hence 
AP = |EsP (1 + B? - 2B cos(|EsP)). (16.12) 


The stationary solutions of system (16.11) are given as a multivalued 
function of A satisfying equation (16.12). This gives a bistable relationship 
equivalent to the graphical method , which is well documented in the literature; 
see, for example, [3, 17], and [28]. 


Differentiate equation (16.12) to obtain 
d|A|’ 
d|Es|? 


= 1 + B? + 2B (|Es P sin(lEs P) — cos(lEs P)) . (16.13) 


To establish where the stable solutions become unstable, consider a slight 
perturbation from the stable situation in the fiber ring, and let 


EAD) = Es T E(t) and Eni) = Es + Eni (0); (16.14) 


where ¢ „(t) is a small time-dependent perturbation to E <. Substitute (16.14) into 
(16.11) to get 


Ey eg HAt Bes +e,) exp iby tAE tE 
sO 
Es + Ën =A + B(Es + En) explilEs |] expli(E sé, + EEs + Ent). (16.15) 
Take a Taylor series expansion of the exponential function to obtain 
exp |i(Esg, + Es +1&P)] = 1+ itEs 7 + EE; + En) + 
Ignore the nonlinear terms in € „. Equation (16.15) then becomes 
Es t+én1 =A + BEs + é) explilEs 101 + LES, Peal g)s 


Since A = E ș — BE cexp[i| E ș |?], the equation simplifies to 


Ene = B (én + iEs Pén + i(Es YEr) exp (AEs P). (16.16) 


Since ¢ is real, it may be split into its positive and negative frequency parts 
as follows: 


é, = Ee” + Ee and En) = Epe + Be On), (16.17) 


where | E , |, | E _ | are much smaller than | E «|, t p is the fiber ring round trip 
time, and A is the amplification rate of a small fluctuation added to a stable 
solution. Substitute equation (16.17) into (16.16). Then the validity of (16.16) at 
all times t requires that 


Eet = B(E, + iJEsPE, + iE2E*) exp (iEs|’), 


E* ettr B(E: - iJEsPE* - i(Es j E, exp (-ilEs/’) 


or, equivalently, 
B(1+ i|EsP)— eX IBE? [E)=(8) 
-iBEE —B*(1-iEsP)—e% JL EL] Loy 


where B= Bexp (i Es P) To obtain a valid solution, the characteristic equation 


must be solved: 
e?ùR — 2e%RB (cos JEsP —|Es|? sin Esl’) +B =0. 
Substituting from equation (16.13), the characteristic equation becomes 


d|A|? 
d\Es/? 


p Rega f h= +B’ =0. (16.18) 


Let pr — dA’. The stability edges for E ; occur where eùr = +] and 
dEsl? 


eR — —], since this is a discrete mapping. Using equation (16.18), this yields 
the conditions 

Da =0 and Dy =2(1+B?). 
Thus the system is stable as long as 


0<D<2 (1 rn B°). (16.19) 


The condition D = 0 marks the boundary between the branches of positive 
and negative slope on the graph of | E ș |? versus | A |? and hence defines the 
regions where the system is bistable. Thus the results from the graphical method 
match with the results from the linear stability analysis. The system becomes 
unstable at the boundary where D = D _,. 


It is now possible to apply four different methods of analysis to determine 
the stability of the electric field amplitude in the SFR resonator. Linear stability 


analysis may be used to determine both the unstable and bistable regions and 
bifurcation diagrams can be plotted. The graphical method [1] is redundant in 
this case. 

There are two methods commonly used to plot bifurcation diagrams—the 
first and second iterative methods. 

The First Iterative Method. A parameter is fixed and one or more initial 
points are iterated forward. Transients are ignored and a number of the final 
iterates are plotted. The parameter is then increased by a suitable step length and 
the process is repeated. There are many points plotted for each value of the 
parameter. For example, the bifurcation diagrams plotted in Chapter 14 were all 
generated using the first iterative method. 

The Second Iterative Method. A parameter is varied and the solution to the 
previous iterate is used as the initial condition for the next iterate. In this way, a 
feedback mechanism is introduced. In this case, there is a history associated with 
the process and only one point is plotted for each value of the parameter. For 
example, most of the bifurcation diagrams plotted in Section 16.6 were plotted 
using the second iterative method. 

The first and second iterative methods are used in other chapters of the book. 


16.6 Instabilities and Bistability 


In the previous section, the results from the linear stability analysis established 
that system (16.11) is stable as long as equation (16.19) is satisfied. A possible 
stability diagram for system (16.11) is given in Figure 16.12, which shows the 
graph of p _ aja? and the bounding lines D ,, = 0 and D4 =2 ( lt B?) 


7 d\Es |? 


when B = 0. 15. 
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Figure 16.12 Stability diagram for the SFR resonator when B = 0. 15 (k = 0. 0225). The system is stable as 
longas 0< <2 (148) 


Table 16.1 lists the first two bistable and unstable intensity regions for the 
SFR resonator (in Watts per meter squared in physical applications) for a range 
of fixed values of the parameter B. 

The dynamic behavior of system (16.11) may also be investigated by plotting 
bifurcation diagrams using either the first or second iterative methods. In order 
to observe any hysteresis, one must, of course, use the second iterative method, 
which involves a feedback. The method developed by Bischofberger and Shen 
[3] in 1979 for a nonlinear Fabry-Perot interferometer is modified and used here 
for the SFR resonator. The input intensity is increased to a maximum and then 
decreased back to zero, as depicted in Figure 16.13. In this case, the simulation 
consists of a triangular pulse entering the ring configuration, but it is not difficult 
to modify the Python program to investigate Gaussian input pulses . The input 
intensity is increased linearly up to 16 Wm “ and then decreased back down to 
zero. Figure 16.13 shows the output intensity and input intensity against the 
number of passes around the ring, which in this particular case was 4000. To 


observe the bistable region, it is necessary to display the ramp-up and ramp- 
down parts of the diagram on the same graph, as in Figure 16.14(b). 


Table 16.1 The first two regions of bistability and instability computed for the SFR resonator to three 
decimal places using a linear stability analysis. 


EE ae eee 

| B [bistable region bistable region 
| aia [att [att [at 
0.05 | 05] 10.970-11.038 | 12.683-16.272 | 16.785-17.704 | 17.878—23.561 


Pos] koraza | 1523-7930 | 2oi-2aar2 | 1461-24000 | 
[09 onse-i | 175911235 | o1arsaaon | oma 
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Figure 16.13 Bifurcation diagram when B = 0. 15 using the second iterative method showing a plot of 
triangular input and output intensities against number of ring passes for the SFR resonator. 


Figure 16.14 shows a gallery of bifurcation diagrams, corresponding to some 
of the parameter values used in Table 16.1 produced using the second iterative 
method. The diagrams make interesting comparisons with the results displayed 
in Table 16.1. 
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Figure 16.14 A gallery of bifurcation diagrams for the SFR resonator (equation 16.11) when (a) B = 0. 05, 
(b) B=0. 15, (c) B = 0.3, and (d) B= 0. 6. In each case, 10000 iterations were carried out. 


A numerical investigation has revealed that for a small range of values close 
to B = 0. 15, (see Figure 16.14(b)), the SFR resonator could be used as a bistable 
device . Unfortunately, for most values of B, instabilities overlap with the first 
bistable region. For example, when B = 0. 3 (Figure 16.14(c)), the first unstable 


region between 1.987 Wm“ and 4. 704 Wm * intersects with the first bistable 


region between 3. 046 Wm and 5. 951 Wm °. Clearly, the instabilities have 
affected the bistable operation. In fact, the hysteresis cycle has failed to 
materialize. Recall that B = ./x, where x is the power coupling ratio. As the 


parameter B gets larger, more of the input power is circulated in the ring, and 
this causes the system to become chaotic for low input intensities. 
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Figure 16.15 Bifurcation diagrams when B = 0. 225 (a) using the second iterative method with feedback 
and (b) using the first iterative method without feedback. 


The first iterative method can be employed to show regions of instability. 
Note, however, that bistable regions will not be displayed since there is no 
feedback in this method. It is sometimes possible for a small unstable region to 
be missed using the second iterative method . The steady state remains on the 
unstable branch until it becomes stable again. Thus in a few cases, the first 
iterative method gives results which may be missed using the second iterative 
method. As a particular example, consider system (16.10) where B = 0. 225. 
Results from a linear stability analysis indicate that there should be an unstable 


region in the range 2. 741 — 3.416 Wm °. Figure 16.15(a) shows that this region 
is missed using the second iterative method, whereas the first iterative method 
(Figure 16.15(b)) clearly displays period-two behavior. In physical applications, 
one would expect relatively small unstable regions to be skipped, as in the 
former case. 

Consider the complex iterative equation 


2an L 
Ena, =i V1 —kEin + VKE, exp | F |En? — e), (16.20) 
OAeff 


which was derived earlier. Equation (16.20) is the iterative equation that 
models the electric field in the SFR resonator. Typical fiber parameters chosen 
for this system are A) = 1.55 x 10 © m;n,=3.2 x 10°29 m2W 4; Agee = 30pm?; 
and L = 80 m. Suppose that equation (16.11) was iterated 10000 times. This 
would equate to hundredths of a second of elapsed time in physical applications 
using these values for the fiber parameters. 
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Figure 16.16 [Python] Bifurcation diagrams for the SFR resonator using equation (16.8) when x = 0.0225 
and (a) Ọ z = 0, (b) ġ; = re (c) @, = Z, and (d) Ọ z = 7. The output power for ramp-up is colored red 


and the output power for ramp-down is colored blue. 


In the work considered so far, the linear phase shift due to propagation Ọ z, 


has been set to zero. Figure 16.16 shows how the bistable region is affected 
when @ ; is nonzero and B = 0. 15. As the linear phase shift increases from zero 


to 4, the first bistable region gets larger and shifts to the right slightly, as 
depicted in Figure 16.16(b). When @, = $, an instability has appeared between 


20 Wm * and 40 Wm and a second unstable region has encroached on the first 
bistable region, as shown in Figure 16.16(c). When @ , = 7, instabilities appear 


at both ends of the bistable region, as shown in Figure 16.16(d). Therefore, the 
linear phase shift can affect the bistable operation of the SFR resonator. Should 
such systems be used for bistable operation, then the results indicate the need to 
control the feedback phase to prevent any instabilities from entering the power 
range in the hysteresis loop. 

In conclusion, the dynamic properties of a nonlinear optical resonator have 
been analyzed using a graphical method, a linear stability analysis, and 
bifurcation diagrams using the first and second iterative methods. The 
bifurcation diagrams give a clearer insight into the dynamics than the results 
from the linear stability analysis and graphical method, but all four used in 
conjunction provide useful results. 


16.7 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


Python Commands Comments 

mgrid # Return coordinate matrices from 
coordinate 
# Vectors. 

scatter # A scatter plot of y vs x with varying 


# marker size and/or color. 


# Program 16a: Intersection of implicit curves. 
# See Figure 16.10(b). 

import numpy as np 

import matplotlib.pyplot as plt 


A, B= 2.2, 0.15 

x, y = np.mgrid[0:4:100j, -4:4:100j ] 

z1 = A + B*x*np.cos(x**2 + y**2) - B*y*np.sin(x**2 
re y**2) - X 


z2 = B*x*np.sin(x**2 + y**2) + B*y*np.cos(x**2 + y* 
"2) - y 


fig, ax = plt.subplots() 

plt.contour(x, y, z1, levels = [0]) 
plt.contour(x, y, z2, levels = [0], colors=’r’) 
ax.set_xlabel(’x(t)’, fontsize=15) 
ax.set_ylabel(’y(t)’, fontsize=15) 
plt.tick_params(labelsize=15) 

plt.show() 


# Program 16b: Iteration of the Ikeda map. 
# See Figure 16.11(b). 

from matplotlib import pyplot as plt 
import numpy as np 

# Parameters 

A, B = 10, 0.15 


def ikeda(X): 
xX, y=X 
xn = A + B*x*np.cos(x**2 + y**2) - B*y*np.sin(x 
EEJ + y**2) 
yn = B*x*np.sin(x**2+y**2) + B*y*np.cos(x**2 + 
y**2) 
return (xn, yn) 


xO = [A, 0] 

X, Y= [], [] 

for i in range(10000): 
xn, yn = ikeda(X0) 
X, Y =X + [xn], Y + [yn] 
XO = [xn, yn] 


fig, ax = plt.subplots(figsize=(10,10)) 
ax.scatter(X, Y, color="blue’, s=0.1) 
plt.xlabel("$Re(E_n)$", fontsize=15) 
plt.ylabel("$Im(E_n)$", fontsize=15) 
plt.tick_params(labelsize=15) 
plt.show() 


# Program 16c: Bifurcation diagram of the Ikeda map 


# See Figure 16.16(d). 
from matplotlib import pyplot as plt 
import numpy as np 


# Parameters 

C = 0.345913 

kappa = 0.0225 

Pmax = 120 

phi = np.pi 

half_N = 1999 

N = 2*half_N + 1 

N1 = 1+ half_N 

esqr_up, esgqr_down = [], [] 


E1 = E2 = 0 
ns_up = np.arange(half_N) 
ns_down = np.arange(N1, N) 


# Ramp the power up 

for n in ns_up: 

E1 np.exp(1j((abs(C*E1))**2 - phi)) 

1j np.sgrt(1 - kappa) np.sgqrt(n * Pmax / 


np.sqrt(kappa) * E2 
esqri = abs(E1)**2 
esqr_up.append([n, esqri]) 


esqr_up = np.array(esqr_up) 


# Ramp the power down 
for n in ns_down: 

E2 = E1 np.exp(1j ((abs(C*E1))**2 - phi)) 

E1 = 1j np.sqrt(1 - kappa) np.sqrt(2 Pmax - 

n Pmax / N1) 

+ np.sqrt(kappa) * E2 

esqri = abs(E1)**2 

esqr_down.append([N-n, esqr1]) 
esqr_down=np.array(esqr_down) 


fig, ax = plt.subplots() 
xtick_labels = np.linspace(0, Pmax, 6) 
ax.set_xticks([x / Pmax * N1 for x in xtick_labels] 


ax.set_xticklabels([’{:.1f}’.format(xtick) for xtic 
k in xtick_labels] ) 


plt.plot(esqr_up[:, O], esqr_up[:, 1], ‘r.’, marker 
size=0.1) 

plt.plot(esqr_down[:, 0], esqr_down[:, 1], ‘’b.’, ma 
rkersize=0.1) 

plt.xlabel(’Input’, fontsize=15) 

plt.ylabel(’Output’, fontsize=15) 

plt.tick_params(labelsize=15) 

plt.show() 


16.8 Exercises 


1. 
Determine the number of fixed points of period one for system (16.10) when 
B = 0. 4 and A = 3. 9 by plotting the graphs of the simultaneous equations. 


Plot iterative maps for equation (16.8), using the parameter values given in 
the text, when x = 0. 0225 and (i) E ;, = 4.5, (ii) E ;, = 6. 3, and (iii) E ;, = 
11. 
Given that 

Ensi =A+t BE, el!" , 


prove that the inverse map is given by 
E (= 5) —i|E„ — Al? 
+1 B p Be 


Given the complex Ikeda mapping 


C 
En = At BE, exp l (0 = all ; 


where A, B, and C are constants, show that the steady-state solution, say, E 
n+1 7 E n= E g, satisfies the equation 


C l > £ 
cos | —— -¢| = — |1 + = — l]. 
1 + |Es/ 2B [E's | 


5. Consider the double-coupler nonlinear fiber ring resonator as shown in 
Figure 16.17. 
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Figure 16.17 Schematic of a double-coupler fiber ring resonator . 


Suppose that 


Ext) = VkEin(t) + i V1 — KEW); 

EIÐ = i VI- KEnlt) + VKE4(; 

E(t) = E(t — tp)e' 0); 
ilt- tr) = FIEC- tr); 

E3(t) = VkE,(0); 

Er(t) = iv1—KEy(0); 

E,(t) = E3(t — tre?" "®?, 
p(t- tr) = E|E x(t - tr)l: 


AA eff 


where the fiber loop is of length L; both halves are of length 1⁄2; t p is 


the time taken for the electric field to complete half a fiber loop; and both 
couplers split the power in the ratio k: 1 —x. Assuming that there are no 
losses in the fiber, show that 


E7(t) = -1 -® E(t - tp)eiP1 eR) ERENT = Ippe Pil tr) + Pal UR 


Consider the complex iterative equation 


Ens1 = A+ BE, exp|i(|E,I°)], 


10. 


used to model the SFR resonator. Use a linear stability analysis to 
determine the first bistable and unstable regions when (a) B = 0. 1, (b) B = 
0. 2, and (c) B = 0. 25 to three decimal places, respectively. 


Plot bifurcation diagrams for Exercise 6, parts (a)-(c), when the maximum 
input intensity is 25 Wm and the input pulse is triangular. 


Plot the bifurcation diagram for the iterative equation in Exercise 6 for B = 
0. 15 when the input pulse is Gaussian with a maximum of 25 Wm *. How 
is the bistable region affected by the width of the pulse? 


Consider the complex iterative equation 
Em1 = A + BE, exp |i (IEn? - 41), 


where B = 0. 15 and @ ņ represents a linear phase shift. Plot bifurcation 
diagrams for a maximum input intensity of A = 3 units when 


(a) 
PL = 4? 
O 
PL = 5 
(c) 
$L = 3n , 
(d) 
LTT, 
(e) 
6. = % 
(f) 
o., = ¥: 
(g8) 
$L = a 


Apply the linear stability analysis to the iterative equation 


TET 2an 
En+1 =1 — KEin F \VKEn exp |z (== biep alk 
4 lo Act 


for the parameter values given in this chapter. Compare the results with the 
bifurcation diagrams. 
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17. Fractals and Multifractals 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To provide a brief introduction to fractals. 

e To introduce the notion of fractal dimension. 

e To provide a brief introduction to multifractals and define a multifractal 
formalism. 

e To consider some very simple examples. 


On completion of this chapter, the reader should be able to 


e plot early stage generations of certain fractals using either graph paper, pencil, 
and rule, or Python; 

determine the fractal dimension of some mathematical fractals; 

estimate the fractal dimension using simple box-counting techniques; 
distinguish between homogeneous and heterogeneous fractals; 

appreciate how multifractal theory is being applied in the real world; 
construct multifractal Cantor sets and Koch curves and plot graphs of their 
respective multifractal spectra. 


Fractals are introduced by means of some simple examples, and the fractal 
dimension is defined. Box-counting techniques are used to approximate the 
fractal dimension of certain early stage generation fractals, which can be 
generated using pencil, paper, and rule. 

A multifractal formalism is introduced that avoids some of the more abstract 
pure mathematical concepts. The theory is explained in terms of box-counting 
dimensions, which are introduced in this chapter. This is potentially a very 
complicated topic, and readers new to this field are advised to look at Example 4 
before attempting to understand the formalism. 

Some applications of multifractal analysis to physical systems in the real 


world are also discussed. A few simple self-similar multifractals are constructed, 
and the analysis is applied to these objects. 


17.1 Construction of Simple Examples 


Definition 1. A fractal is an object that displays self-similarity under 
magnification and can be constructed using a simple motif (an image repeated on 
ever-reduced scales). 


Fractals have generated a great deal of interest since the advent of the computer. 
Many shops now sell colorful posters and T-shirts displaying fractals, and some 
color fractals have been plotted in Chapter 15 Although the Julia sets and the 
Mandelbrot set are not true fractals, they do have fractal structure. Many objects 
in nature display this self-similarity at different scales; for example, cauliflower, 
ferns, trees, mountains, clouds, and even blood vessel networks in our own 
bodies have some fractal structure. These objects cannot be described using the 
geometry of lines, planes, and spheres. Instead, fractal geometry is required. 
Fractal analysis is being applied in many branches of science—for example, to 
computer graphics and image compression (for example, take a closer look at the 
images on the Web) and to oil extraction from rocks using viscous fingering — 
and multifractal analysis has expanded rapidly over recent years (see later in this 
chapter). The reader is directed to Falconer’s text [8] for a simple introduction to 
fractals and their many applications and reference [9] gives a more mathematical 
perspective. 

It is important to note that all of the fractals appearing in this textbook are 
early generation fractals. However, there is nothing to stop scientists from 
imagining an ideal mathematical fractal that is constructed to infinity. Some of 
these fractals will now be investigated. 

The Cantor Set . The Cantor fractal was first considered by Georg Cantor in 
1870. It is constructed by removing the middle third of a line segment at each 
stage of construction. Thus at stage 0, there is one line segment of unit length. At 
stage 1, the middle third is removed to leave two segments each of length L. At 


stage 2, there will be four segments each of length 5 Continuing in this way, it 


is not difficult to see that at the kth stage, there will be N = 2% segments each of 


length | = 3™%. An early stage construction (up to stage 3) is shown in 
Figure 17.1. 


Stage 0 
Stage | 
Stage 2 


Stage3 _ _ 


Figure 17.1 An early generation of the Cantor set. 


If this process is continued to infinity, then 
lim 2 =co and lim aa, 
The Cantor set will therefore consist of an infinite number of discrete points 
that, unfortunately, is impossible to generate on a computer screen. However, all 
is not lost. By using the ternary number system, it is possible to classify which 
points in the unit interval belong to the Cantor set and which do not. Recall that 
ternary proper fractions can be expanded by applying a simple algorithm: Treble 
the numerator of the proper fraction concerned; when this number is larger than 
or equal to the denominator, subtract the denominator, noting down the ternary 
factor above the line, and continue with the remainder. For example, 
120102 1 
412 
5 15 
= = 0.120102, since 139 
2618 
4 12 
D ay 
where the underlining after the decimal point represents a recurring decimal. It is 
not too difficult to show that the Cantor set can be identified by points whose 
ternary fractions consist of zeroes and twos only. Thus p 4 = 0. 20202 will 


belong to the Cantor set, whereas p = 0. 120102 will not. 


The Koch Curve . Helge von Koch first imagined the Koch curve in 1904. It is 
constructed by replacing a unit line segment with a motif consisting of four line 
segments each of length h, as depicted in Figure 17.2. 


Stage 0 Stage | 


Ad CA. AS 


Stage 2 Stage 3 
Stage 4 Stage 5 


Figure 17.2 [Python] Construction of the Koch curve up to stage 5. 


A simple Python program is given in Section 17.5 to plot early generations 
of the Koch curve. Note that at the kth stage there are N = 4% line segments each 
of length | = 3~*. Thus for the mathematical fractal constructed to infinity, 

lim 4°=co and lim 3*=0, 


k= k— oo 
so the mathematical Koch curve consists of a curve that is infinitely long. 
The Koch Square . Consider a variation of the Koch curve that is 
constructed by replacing one line segment with five line segments each of length 
i. Furthermore, suppose that these curves are attached to the outer edge of a unit 


square. The first five stages of construction are shown in Figure 17.3. 
It is possible to determine the area and perimeter bounded by the Koch 
square in the following way. Suppose that at stage 0 that the square has area A o 


= 1 unit? and that the area at stage k is A,. Then 


A, = 1+4@°’) unit’. 


Stage 0 Stage 1 


Stage 2 Stage 3 


Stage 4 Stage 5 


Figure 17.3 The Koch square fractal constructed to stage 5. Note that this fractal was also plotted in 
Chapter 1 using the Turtle module. See Figure 1.10. 


Figure 17.4 The inverted Koch square at stage 5. 
At stage 2, the area is given by 
A2 =1+4(37)+4x5x (3) unit’. 
Continuing in this way, the area at the kth stage is given by 
Ay = 1 +437) +4x5 x (34) 44x 5° x (3%) +...44x 50! x (3) unit’. 


Take the limit k > oo, Then 
Aw = 1+ fi +: y 4x 5i x (97D) unit? 
> 9 i=] 


This is the sum of an infinite geometric series, and hence 
4x5 
92 
A»s=l1+-+ 5 
9 J=2 


32 


=2 unit’. 


It is not difficult to show that the perimeter P ; at the kth stage is given by 


k 
r= 4x(3) : 
3 


and P ,, = œ. Therefore, the Koch square has infinite perimeter and finite area. 


It is possible to construct an inverted Koch square fractal by attaching the Koch 
curves to the inner edge of the unit square. The result up to stage 5 is shown in 
Figure 17.4. 

The Sierpinski Triangle . This fractal may be constructed in a number of 
ways; see the exercises at the end of the chapter (Section 17.6). One way is to 
play a so-called chaos game with a die. Consider an equilateral triangle with 
vertices A, B, and C, as depicted in Figure 17.5. 


A 


C B 


Figure 17.5 A triangle used in the chaos game with an initial point x ọ. 


The rules of the chaos game are very simple. Start with an initial point x 9 


somewhere inside the triangle. 

Step 1. Cast an ordinary cubic die with six faces. 

Step 2. If the number is either 1 or 2, move half way to the point A and plot a 
point. 

Step 2. Else, if the number is either 3 or 4, move half way to the point B and 
plot a point. 

Step 2. Else, if the number is either 5 or 6, move half way to the point C and 
plot a point. 

Step 3. Starting with the new point generated in Step 2, return to Step 1. 


The die is cast again and again to generate a sequence of points {x 9, X 1, X 
9, X 3,...$. As with the other fractals considered here, the mathematical fractal 


would consist of an infinite number of points. In this way, a chaotic attractor is 
formed, as depicted in Figure 17.6. A Python program is given in Section 17.5. 
The first few initial points are omitted to reveal the chaotic attractor . This 
object is known as the Sierpinski triangle. 
Stochastic processes can be introduced to obtain fractals that look more like 
objects in nature. We restrict ourselves to two-dimensional figures only in this 
chapter. 


Definition 2. 
An iterated function system (IFS) is a finite set 
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Figure 17.6 [Python] An early stage-generation Sierpiński triangle plotted using the chaos game. There 


are 50,000 points plotted. Note that the Turtle module was used to plot the Sierpinski triangle in Chapter 1. 
See Figure 1.11. 


T,,T >, T3,..., T „of affine linear transformations of 2, where 


T (x, y) = (ajx $ biy +Cj, dd jx + éjy + fi) : 


Furthermore, a hyperbolic iterated function system is a collection of affine linear 
transformations that are also contractions. 


The IFSs follow basic rules, as in the case of the chaos game used to generate 


the Sierpinski triangle. The rules of the chaos game can be generalized to allow 
greater freedom as follows: Step 1. Create two or more affine linear 
transformations. 

Step 2. Assign probabilities to each of the transformations. 

Step 3. Start with an initial point. 

Step 4. Select a random transformation to get a second point. 

Step 5. Repeat the process. 

An IFS consisting of four transformations was used to generate Figure 17.7. 
This figure resembles a fern in nature and is known as Barnsley’s fern. A 
Python program is listed in Section 17.5. 

The affine linear transformations may be found by taking reflections, 
rotations, scalings, and translations of triangles that represent the fronds of 
the fern . 


Figure 17.7 [Python] A fractal attractor of an IFS. Barnsley’s fern, generated using 60,000 points. 


17.2 Calculating Fractal Dimensions 
Definition 3. 


A self-similar fractal has fractal dimension (or Hausdorff index ) D p given by 
_ InN) 
tint’ 


where | represents a scaling and N(1) denotes the number of segments of length 1. 
Thus the relationship 


N(D) œ (I)? (17.1) 


is also valid. The number D ș which need not be an integer, gives a measure of 
how the density of the fractal object varies with respect to length scale. 


Definition 4. A fractal is an object that has noninteger fractal dimension. 
(This is an alternative to Definition 1). 


Example 1. Determine the fractal dimension of 
(i) the Cantor set, 
(ii) the Koch curve, 
(iii) the Koch square, and 
(iv) the Sierpinski triangle. 


Solution. (i) A construction of the Cantor set up to stage 3 is depicted in 
Figure 17.1. At each stage, one segment is replaced with two segments that are 
1 the length of the previous segment. Thus in this case, N(I) = 2 and ; = L. The 


mathematical self-similar Cantor set fractal constructed to infinity will therefore 
have dimension given by 


In2 

D a ~ 
In3 

Note that a point is defined to have dimension zero and a line dimension one. 
Hence the Cantor set is more dense than a point but less dense than a line. 


(ii) The Koch curve is constructed up to stage 5 in Figure 17.2. In this case, 
one segment is replaced with four segments which are scaled by 5 therefore, 


0.6309. 


N(I) = 4 and ] = L. The mathematical self-similar Koch fractal generated to 


infinity will have dimension 


In4 
-= — x 1.2619. 
I 1n3 
Thus the Koch curve is more dense than a line but less dense than a plane, which 
is defined to have dimension two. 

(iii) The Koch square generated to stage 5 is shown in Figure 17.3. Note that 
this object is not strictly self-similar; magnification will not reveal smaller Koch 
squares. However, it is possible to define a fractal dimension, since there is a 
scaling behavior. For the Koch square , 

— Ins 


. = — x 1.4650. 
j In3 


Hence the Koch square is more dense than the Koch curve but is still less dense 
than the plane. Note that the inverted Koch square will have exactly the same 
fractal dimension. 

(iii) The mathematical Sierpinski triangle fractal (see Figure 17.6) may be 
constructed by removing the central triangle from equilateral triangles to 
infinity. A motif is shown in Figure 17.8 and a Python program for constructing 
the fractal in this way is listed in Chapter 1. 

It is important to note that the scaling l referred to in Definition 2 is linear. 
Thus the linear scale is i since the sides of the smaller triangles are half as long 


as the sides of the original triangle in the motif. At each stage, one triangle is 
replaced with three triangles, so / = i and N(I) = 3. The fractal dimension of the 


mathematical Sierpinski triangle generated to infinity is 


In3 
= — & 1.5850. 
Í In? 
The Sierpinski triangle has the highest dimension in examples (i)—(iv) and is 
therefore the most dense. 


Figure 17.8 The motif used to generate the Sierpinski triangle. 


Box-Counting Dimensions. The fractal dimensions calculated so far have 
been for hypothetical fractal objects that cannot exist in the real world. 
Mandelbrot [17] shows how fractals appear throughout science and nature. 
Trees, clouds, rocks, and the fractals generated in earlier chapters can display a 
certain type of scaling and self-similarity. Mandelbrot showed that these objects 
obey a power law as described in equation (17.1) over a certain range of scales. 
By covering the object with boxes of varying sizes and counting the number of 
boxes that contain the object, it is possible to estimate a so-called box-counting 
dimension, which is equivalent to the fractal dimension. Mandelbrot defined the 
fractal dimension to be 


l I 
D; = lim Ba 
30 -lnl 


where N(1) boxes of length / cover the fractal object. These boxes need not be 
square. 
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Figure 17.9 Different coarse coverings of the Koch curve generated to stage 6. 
Consider the following two examples (see Figures 17.9 and 17.11). 


Example 2. The Koch curve is covered with boxes of varying scales, as shown 
in Figure 17.9. Use a box-counting technique to show that the object obeys the 
power law given in equation (17.1) and hence estimate the box-counting 
dimension. 


Solution. Table 17.1 gives the box count N(/) for the different scalings 1, and the 
natural logs are calculated. 

Using the least-squares method of regression, the line of best fit on a log-log 
plot is given by y ~ 1. 2246x — 0. 2817, and the correlation coefficient is 
approximately 0. 9857. The line of best fit is shown in Figure 17.10. 


Table 17.1 Box-count data for the Koch curve generated to stage 6. 
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Figure 17.10 The line of best fit on a log-log plot for the early generation Koch curve. The correlation 
coefficient is 0.9857. 


Therefore, the box-counting dimension of the Koch curve generated to stage 
6 is approximately 1. 2246. There is obviously a scaling restriction with this 
object since the smallest segment is of length 3° ~ 0. 0014 units and the box- 
counting algorithm will break down as boxes approach this dimension. There is 
always some kind of scaling restriction with physical images as there are a 
limited number of pixels on a computer screen. It is interesting to note that the 
mathematical Koch curve has a higher dimension of approximately 1. 2619. This 
is to be expected as true mathematical fractal is a lot more dense. 


Example 3. 
A chaotic attractor comprising 5000 points for the Hénon map 


E 2 =e 
Xn+1 = 1.2 + 0.4y, = Xp Yn+1 = Xn 


is covered with boxes of varying scales, as shown in Figure 17.11. Use a box- 
counting technique to show that the object obeys the power law given in 
equation (17.1) and hence estimate the box-counting dimension. 


Figure 17.11 Different coarse coverings of the Hénon chaotic attractor. 


Solution. Table 17.2 gives the box count N(/) for the different scalings 1, and 
the natural logs are calculated. 


Table 17.2 Box-count data for the Hénon map with 5000 points 
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Using the least-squares method of regression, the line of best fit on a log-log 
plot is given by y ~ 1. 0562x + 1. 1810, and the correlation coefficient is 
approximately 0. 9961. The line of best fit is shown in Figure 17.12. 
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Figure 17.12 The line of best fit on a log-log plot for the early generation Hénon attractor. The correlation 
coefficient is 0.9961. 


Therefore, the box-counting dimension of the Hénon attractor with 5000 
points is approximately 1.0562. There is a scaling restriction in this case as there 
are only 5000 data points. Once more, the dimension of the mathematical fractal 
with an infinite number of data points will be larger. 


The Hénon map is not self-similar and is, in fact, a multifractal . See the next 
section. Recent applications of fractals are presented in [3]. 


17.3 A Multifractal Formalism 


In the previous section, it was shown that a fractal object can be characterized by 
its fractal dimension D » which gives a measure of how the density varies with 


respect to length scale. Most of the fractals appearing earlier in this chapter can 
be constructed to the infinite stage in the minds of mathematicians. They are 
homogeneous since the fractals consist of a geometrical figure repeated on an 
ever-reduced scale. For these objects, the fractal dimension is the same on all 
scales. Unfortunately, in the real world, fractals are not homogeneous; there is 
rarely an identical motif repeated on all scales. Two objects might have the same 
fractal dimension and yet look completely different. It has been found that real- 
world fractals are heterogeneous ; that is, there is a nonuniformity possessing 
rich scaling and self-similarity properties that can change from point to point. 
Put plainly, the object can have different dimensions at different scales. It should 
also be pointed out that there is always some kind of scaling restriction with 
physical fractals. These more complicated objects are known as multifractals, 
and it is necessary to define continuous spectra of dimensions to classify them. 

There are many different ways in which a mathematician can define 
dimension , and the subject can become very complicated and abstract. For 
example, there is Hausdorff dimension, topological dimension , Euclidean 
dimension , and box-counting dimension to name but a few. More details on the 
pure mathematical approach to multifractals are presented in [9] and [23]. The 
most widely used method of determining multifractal spectra is that of Falconer 
[9], which is described briefly below. 

Let p be a self-similar probability measure defined on an object § c R4, 


where p(B) is a probability measure determined from the probability of hitting 
the object in the box B ,(1) and Ņ œ 3 is the number of boxes in the grid. The 


generalized fractal dimensions D , or, alternatively, the f(a) spectrum of 
singularities may be computed using box-counting techniques. First, consider 
the generalized fractal dimensions. Cover the object S with a grid of boxes (B 
(1); - ,% of size l as in Section 17.1. The qth moment (or partition function ) Z q 
is defined by 


N 
zoe >* [WB = >° pd, (17.2) 
i=] 


u(B)+0 


For self-similar multifractals, given a real number q, t(q) may be defined as 
the positive number satisfying 


N 
>, Pin? =1, 


i=1 
(17.3) 


where p ; represent probabilities (X ; -4 ™ p ; = 1) with r ; fragmentation 
ratios . The function t : R — Rt is a decreasing real analytic function with 


lim t(g)=oco and lim t(qg) = —-ov. 


JERO q>% 


The generalized dimensions D , and the scaling function t(q) are defined by 


In ZD 
-lnl ` 


t(q) = DJA - q) = lim 


(17.4) 
The generalized dimensions are obtained from an assumed power-law 
behavior of the partition function in the limit as 1 > 0 and N > œ, 


Za OC Pie) . 


Definition 5. The generalized (box-counting) fractal dimensions D ,, where 
q € XR, are defined by 


EPRE. Ind, PAO 


D 
i0 l-q -lini 


(17.5) 


where the index i labels the individual boxes of size | and p ,(I) denotes the 


relative weight of the ith box or the probability of the object lying in the box. 
Hence 


Ni) 
U== 
pi) = -7 
where N ,(/) is the weight of the ith box and N is the total weight of the object. 
When q = 0, 
In NC 
Do = Dy = lim el) 
00 —In(/) 


where N(I) is the number of boxes contained in the minimal cover. When q = 1, 
L’ Hopital’s Rule can be applied (see the exercises in Section 17.6) to give 


N 
Di In i 
D; = lim Lit PilM(pi) piln(pi) 
30 — In(Z) 


which is known as the information dimension . This gives an indication of how 
the morphology increases as l? > 0. The quantity D 5 is known as the correlation 


dimension and indicates the correlation between pairs of points in each box. The 
generalized dimensions D 3, D 4, ... are associated with correlations between 


triples, quadruples, etc., of points in each box. 
Now consider the so-called f(a) spectrum of dimensions. The weight p , of 


segments of type s scales with the size | of a box as follows: 
psD œ D)“, 
where « , is the so-called coarse Hölder exponent defined by 


In ps) 
Q; = ———. 
' In/ 


The number of segments N , of type s scales with the size l of a box according to 
ND x (DY. 


The exponents a , and f , can then be used to determine f(a), as demonstrated in 
the examples in the next section. 

In many cases, f(a) = dimy S , is related to the Hausdorff-Besicovich dimension 
of the set x € S; see [9] for more information. In most cases, a multifractal 
spectrum f(a) may be obtained from 1(q) by a so-called Legendre transformation 
, which is described here briefly for completeness. Hence 


PO ers 


The f(a) can be derived from 1(q), and vice versa, by the identities 
f (a(q)) = ga(g)+t(g) and a=-—. 


(17.6) 
It is known that the function f(a) is strictly cap convex (see Figure 17.13(c)), and 
that a(q) is a decreasing function of q. 

In practice, to compute 1(q) using the partition function, the following three 
steps are required: 


e Cover the object with boxes (.(/) ye of size | and compute the 


corresponding box-measures u; = u (B;:(D) = p:(D. 


e Compute the partition function Z , for various values of I. 

e Check that the log-log plots for Z , against | are straight lines. If so, then 1(q) 
is the slope of the line corresponding to the exponent q. 

In summary, 1(q) and D , can be obtained from equations (17.2) and (17.4), and 


the f(a) values can be determined as above or computed (see [6]) using the 
expressions 


YY, wig. D Inpetg. D 
= l = ee 
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(17.7) 
and 
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(17.8) 


where p ,(q, D) are the normalized probabilities 
pi) 
Die pil) 


In physical applications, an image on a computer screen of 512 x 512 pixels is 
typically used. A problem arises with negative values of q; boxes with very low 


Lilg, 1) = 


measure may contribute disproportionately. Several papers have been published 
addressing this clipping problem ; see [2], for example. This is not a problem 
with some of the physical applications discussed here since most of the useful 
results are obtained for 0 < q < 5. 

The multifractal functions t(q), D ,, and f(a) have typical forms for self-similar 


measures. For example, consider f : [Q@min, max] > N, then -a min and -a max 


are the slopes of the asymptotes of the strictly convex function t. The geometry 
of the Legendre transform determines that f is continuous on [Œ min, @max |] and 


f (Qmin) = f (Cmax) = O. It is not difficult to show that 1(0) = D , and q = 0 


corresponds to the maximum of f(a). When q = 1, t(q) = 0, and so f(a) = a. 
Moreover, < (fæ)-a))=q-1=0- Thus f(a) is tangent to f(a) = a at g = 1. 


Typical 1(q), D ,, and f(a) curves and some of their properties are shown in 


Figure 5.13. Note that in Figure 17.13(a), the line asymptotic to the curve as q > 


oo has slope —a min and line asymptotic to the curve as q > ~œ has slope -a max: 

There are major limitations associated with this so-called fixed-size box- 
counting algorithm , and in many applications, results are only reliable for a 
narrow range of q values, typically 0 < q <5. In [16], Mach, Mas, and Sagués 
also consider a fixed-weight box-counting algorithm , where the measure 


quantities p ; are fixed and the size factors r ; vary; see equation (17.3). They 


show that the fixed-size box-counting algorithm gives good results for small 
positive q, and the fixed-weight box-counting algorithm can be used to give 
good results for small negative q. Recently, Alber and Peinke [2] developed an 
improved multifractal box-counting algorithm using the so-called fuzzy discs 
and a symmetric scaling-error compensation. They apply their method to the 
Hénon map with great success. 

Some simple multifractals are constructed in the next section, and a 
multifractal analysis is applied to determine multifractal spectra. 


17.4 Multifractals in the Real World and Some 


Simple Examples 


Since the publication of the seminal paper by Halsey et al. [12] on multifractals, 
there has been intense research activity, and numerous papers have been 
published in many diverse fields of science. A small selection of this research 
material will be discussed in order to demonstrate how the analysis is being 


applied in the physical world. 
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Figure 17.13 Typical curves of (a) the t(q) function, (b) the D q Spectrum, and (c) the f(a) spectrum. In 
case (c), points on the curve near @ min correspond to values of q > ©, and points on the curve near @ max 
correspond to values of q > -©. 


In 1989, Chhabra et al. [6] used equations (17.7) and (17.8) to determine the 
f(a) spectrum for fully developed turbulence in laboratory and atmospheric flows 
directly from experimental data. The same methods were employed by Blacher 
et al. [4] in 1993 and Mills et al. [18] and [19], when characterizing the 
morphology of multicomponent polymer systems. They found that there was a 
correlation between the mechanical properties of the samples and their 


respective f(a) curves. There have been many other studies into the mechanical 
properties of plastics and rubbers using image analysis techniques. A very useful 
tool is the multifractal analysis of density distributions. The analysis is usually 
applied to elemental dot maps produced by scanning electron microscopy 
coupled with energy dispersive X-ray spectroscopy . The analysis is used to 
produce generalized dimensions, and it has been found that w = D ọ — D 5 is 


related to factors such as tensile strength, elongation at break, and energy to 
break. The quantity w is a measure of the nonuniformity of the structure. The 
smaller the value of w, the more homogeneous the structure and the stronger the 
material. Multifractals are being applied in image compression techniques and 
signal processing . In [24], Sarkar and Chaudhuri estimate fractal and 
multifractal dimensions of grey-tone digital images, and in [11] a multifractal 
approach is used to extract relevant information on textural areas in satellite 
meteorological images. Generalized dimensions are being applied extensively in 
the geosciences to classify sedimentary rocks . In [21], Muller, Huseby, and 
Saucier relate porosity and permeability to the multifractal spectra of the relevant 
samples. The analysis is also often applied to diffusion-limited aggregates 
(DLA) clusters. For example, Mach, Mas, and Sagués [16] consider the 
electrodeposition of zinc sulfate on an electrode and apply the fixed-size and 
fixed-weight box algorithms to obtain the generalized dimensions. Multifractal 
characteristics are displayed by propagating cracks in brittle materials, as 
reported by Silberschmidt in [26]. In physics, the box-counting method was 
applied to show the multifractality of secondary-electron emission sites in silicon 
in [14]. In economics , Calvet and Fisher [5] provide a unified treatment on the 
use of multifractal techniques in finance. An accessible text on fractals and 
multifractals applied to ecology and aquatic science is given in [25]. 

Other examples of multifractal phenomena can be found in, for example, 
stock market analysis , rainfall, and even the distribution of stars and galaxies in 
the universe. Multifractal phenomena in chemistry and physics are presented in 
[27]. The examples listed above are by no means exhaustive, but the author 
hopes that the reader will be encouraged to look for more examples in his/her 
own particular field of specialization. 

In the following examples, simple multifractals are constructed using 
nonuniform generalizations of the Cantor set and the Koch curve. Multifractal 
spectra curves are plotted in both cases. 


Example 4. A Cantor multifractal set is constructed by removing the middle 
third segment at each stage and distributing a weight so that each of the 


remaining two segments receive a fraction p ; and p > units, respectively, and 
such that p ; + p > = 1. Illustrate how the weight is distributed after the first two 


stages of construction. Plot t(q) curves, D , spectra, and f(a) spectra when (i) 
1 2 (ji 1 8 
Pi = 3 and p2 — 7 (ii) Pı — 5 and p2 — 5 
Which of the multifractals is more heterogeneous? 


Solution. Figure 17.14 illustrates how the weight is distributed up to the second 
Stage of construction. 
At stage k, each segment is of length (E) and there are N = 2‘ segments. 


Assign a unit weight to the original line. Then for k = 1, one 


Stage 0 Po= 1 


2 Pi Pih PPi P 


Figure 17.14 The weight distribution on a Cantor multifractal set up to stage 2. 


line segment has weight p , and the other has weight p >. For k = 2, there are 
four segments: one with weight p , ?, two with weight p , p 5 and one with 
weight p „°. At stage 3, there are eight segments: one with weight p , 3, three 
with weight p , ° p 5, three with weight p 4 p > ?, and one with weight p 5 °. It is 
not difficult to see that at stage k, there will be 


segments of weight p 4 $ p K5. From equation (17.2), the partition function 
Z (1) is given by 


k 
—k k gs _g(k-s c ank 
s=0 È 


from the binomial theorem. Therefore, from equation (17.4), 


__ In(pt + p3) 
t(q) = Dg — q) = lim hn 
sO 
In(p? + p? 
T(qg) = a la A 
In3 


The D , spectrum can be plotted using continuity at q = 1. 
To construct an f(a) spectrum, consider how the weight p , and the number of 
segments N , each of type s, scales with segment size |. Now 


ps œ (N°, and ND œ I", 
where s = 0, 1, ..., k. Now p ¿= p 4° p > © and 1 = 3%% Hence 


sln py + (k -— s)ln po 
a, = 
' In 3-* 


The number of segments of weight p , at the kth stage is 


Hence 


These parametric curves may be plotted to produce f(a) using Python. The 
programs are listed in the next section. 


(i) Suppose that pix i and p= £. The multifractal curves are given in 
Figure 17.15. 
b 
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Figure 17.15 Multifractal spectra for part (i) of Example 1 when p 1 = 13 and p 2 = 22. (a) 1(q) curve; (b) 
D q spectrum; (c) f(a) spectrum when k = 500. 
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Figure 17.16 [Python] Multifractal spectra for part (ii) of Example 1 when p 1 = 19 and p 2 = 84: (a) 1(q) 
curve; (b) D q Spectrum; (c) f(a) spectrum when k = 500. 


ii) Suppose that — 1 and — 8. The multifractal curves are given in 
PP pı 9 P2 9 


Figure 17.16. 


Notice that in all cases, D) = D f= i x 0.63. The multifractal in case (ii) 
a n- 


is more heterogeneous. The f(a) curve is broader and the generalized dimensions 
D , cover a wider range of values. 


The following images and plots have been generated using image processing 
techniques (see Chapter 18). 


(d) 


p, = 0.25 | P2 = 0.3 


(e) (f) 


Figure 17.17 Multifractal images and the weight distribution motifs. The weights are related to the gray 
scale ; for example, p 1 = 1 would be white and p 1 = 0 would be black on this scale. 


Example 5. Consider the images in Figure 17.17, produced by applying the 
weight distributions as indicated. Using the computer algorithms described in 


various papers, it is possible to compute the f(a) spectra. The theoretical 
multifractal spectra may be derived analytically using methods similar to those 
used in [9]. Compare the theoretical and numerical f — alpha curves for each of 
the images in Figures 17.7(b), (d), and (f). 


Solution. The computed multifractal spectra are plotted in Figure 17.18. For the 
motifs displayed in Figure 17.17, it is not difficult to show that 


E In (p + p5 + p, + pi) 
p In(2) 


and then the theoretical f(a) spectrum can be plotted using the relations 


dt 


& = -—, 
dq 


f=qa+r. 

The reader is asked to plot these multifractal spectra in the coursework exercises 
in Chapter 22 

Note that in Figure 17.18(a), the f(a) curve is skewed right indicating clusters of 
brighter pixels. In Figure 17.18(b), the f(@) curve is skewed left indicating 
clusters of darker pixels. Finally, in Figure 17.18(c), the f(a) curve is not skewed 
indicating there are no clusters. Notice that dispersion (given by the width of the 
f(a) curves) is greatest in 17.18(b) and least in 17.18(c), where the figure is most 
homogeneous. The heights of the f(a) curves gives a measure of density. 


Example 6. Plot the multifractal spectra for the images in Figures 17.19(a), 
(c), and (d). 


Solution. The computed multifractal spectra are plotted in Figures 17.19(b), (d), 
and (f). 

The plots in Figure 17.19 are typical of those displayed in the research 
literature. The f(a) curves give researchers a method to quantify density (the 
height of the f(a)) curve, dispersion (the width of the f(a) curve), and clustering 
(the f(a) curve is skewed right for cells and left for gaps). Interested readers 
should consult our recent papers [20, 28], and [29]. 

Mulitifractal generalized Sierpinski triangles are considered in [10], anda 
multifractal spectrum of the Hénon map is discussed in [2]. 


17.5 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 


comb(k,Ss) # The number of combinations of k 


# taken s at a time. 
randint(a,b) |# Return a random integer N, a<=N<=b. 


f(a) 
o 
oW a 
A 
Ni 
n 


a 


Numerical + +++ 
Theoretical 


Figure 17.18 Plots for Example 5: the f(a) spectra showing both theoretical (plotted with a blue line) and 
numerical (plotted with red plus signs) curves. In all cases q was taken in the range — 10 < q < 10. 


(e) (f) 


Figure 17.19 Plots for Example 6: binary images of microbes on a surface, (a), (c), and (e), and the 
corresponding f(a) spectra (b), (d), and (f). In all cases q was taken in the range - 10 < q < 10. 


# Program 17a: Plotting the Koch curve. 
# See Figure 17.2. 


import numpy as np 
import matplotlib.pyplot as plt 
from math import floor 


k=6 

n_lines = 4**k 

h = 3**(-k); 

x = [0]*(n_lines+1) 
y = [0]*(n_lines+1) 
x[0], y[0] = 0, © 


segment=[0] * n_lines; 


# The angles of the four segments. 
angle=[0, np.pi/3, -np.pi/3, 0] 
for i in range(n_lines): 
m=i 
ang=0 
for j in range(k): 
segment[j] = np.mod(m, 4) 
m = floor(m / 4) 
ang = ang + angle[segment[j]] 


x[i+1] 
y[i+1] 


= x[i] + h*np.cos(ang) 
= y[i] + h*np.sin(ang) 
plt.axis(’equal’ ) 

plt.plot(x,y) 

plt.show() 


# Program 17b: The chaos game and Sierpinski triang 
# See Figure 17.6. 

import matplotlib.pyplot as plt 

from random import random, randint 


import numpy as np 


def midpoint(P, Q): 
return (0.5*(P[O] + Q[0]), 0.5*(P[1] + Q[1])) 


# The three vertices. 
vertices = [(0, 0), (2, 2*np.sqrt(3)), (4, 0)] 


iterates = 50000 
x, y = [O]*iterates, [0]*iterates 


x[0], y[O] = random(), random() 


for i in range(i, iterates): 
k = randint(0, 2) 
x[i], y[1] = midpoint( vertices[k], 
1], y[i-1]) ) 


fig, ax=plt.subplots(figsize=(8, 8)) 
ax.scatter(x, y, color = 'r’, s=0.1) 
ax.axis(’off’ ) 

plt.show() 


# Program 17c: Barnsley’s fern. 
# See Figure 17.7. 

import numpy as np 

import matplotlib.pyplot as plt 
import matplotlib.cm as cm 


# The transformation T. 
f1 = lambda x,y: (0., 0.2*y) 


f2 = lambda x,y: (0.85*x + 0.05*y, -0.04*x + 0.85*y 


+ 1.6) 


f3 = lambda x,y: (0.2*x - 0.26*y, 0.23*x + 0.22*y + 


1.6) 


f4 = lambda x,y: (-0.15*x + 0.28*y, 0.26*x + 0.24*y 


+ 0.44) 
fs = [f1, f2, f3, f4] 


num_points = 60000 


width = height = 300 
fern = np.zeros((width, height) ) 


xX, Y= 90, 0 

for 1 in range(num_points): 
# Choose a random transformation. 
f = np.random.choice(fs, p= 


(x[i- 


[0.01, 0.85, 0.07, ©.07]) 
x, Y= f(x, Y) 
# Map (x,y) to pixel coordinates. 
# Center the image. 


cx, cy = int(width / 2 x width / 10), int(y 


+ 
height / 10) fern[cy, cx] 1 
fig, ax = plt.subplots(figsize=(8, 8)) 
plt.imshow(fern[::-1,:], cmap=cm.Greens ) 
ax.axis(’off’ ) 
plt.show() 


# Program 17d: Plot multifractal tau curve, D_q cur 
ve and f(alpha) curve. 

# See Figure 17.16. 

import numpy as np 

import matplotlib.pyplot as plt 

import scipy.misc 


plt.subplots_adjust(hspace = 1) 
plt.figure(1) 


# The tau curve. 
= np.linspace(-20, 20, 1000) 

= (np.log((1/9)**x + (8/9)**x) / np.log(3)) 
plt.subplot(3, 1, 1) 

plt.plot(x, y) 

plt.xlabel(’$q$’, fontsize=15) 
plt.ylabel(r’$\tau(q)$’, fontsize=15) 
plt.tick_params(labelsize=15) 


# The D_q curve. 

x1 = np.linspace(-20, 0.99, 100) 

x2 = np.linspace(0.99, 20, 100) 

Dqi = (np.log((1/9)**x1 + (8/9)**x1) 7 (np.log(3) * 
(1-x1))) 

Dq2 = (np.log((1/9)**x2 + (8/9)**x2) / (np.log(3) * 
(1-x2))) 


plt. 
plt. 
plt. 
plt. 
plt. 


subplot(3, 1, 2) 

plot(x1, Dgi, x2, Dq2) 
Xlabel(’q’, fontsize=15) 
ylabel(’$D_q$’, fontsize=15) 
tick_params(labelsize=15) 


# The f(alpha) curve. 


p1, 
k 
S 
X 


p2 =1/9, 8/9 

500 

np.arange(500) 
(s*np.log(p1) + (k- 


s)*np.log(p2)) / (k*np.log(1/3) ) 


(np.log(scipy.misc.comb(k,s))) / (k*np.lo0og(1/3)) 


plt. 
plt. 
plt. 
plt. 
plt. 
plt. 


subplot(3, 1, 3) 

plot(x, f) 

Xlabel(r’$\alpha$’, fontsize=15) 
ylabel(r’$f(\alpha)$’, fontsize=15) 
tick_params(labelsize=15) 

show() 


17.6 Exercises 


1. (a) 


Consider the unit interval. A variation of the Cantor set is constructed by 1 
segments each of length i. Thus at stage 1, remove the segments between 


from the unit interval, leaving three line segments remaining. Continuing | 
construct the fractal up to stage three either on graph paper or on a compu 
length of segment remaining at stage k. Determine the fractal dimension o 


fractal constructed to infinity. 


(b) 


A Lévy fractal is constructed by replacing a line segment with a try square 
stage one line segment of length, 1, say, is replaced by two of length 3 
2 


up to stage 7 either on graph paper or on a computer screen. When using ¢ 
to draw a skeleton (dotted line) of the previous stage. What is the true frac 


object generated to infinity? 


2 


(c) 


(d) 


A Koch snowflake is constructed by adjoining the Kock curve to the outer 
length equilateral triangle. Construct this fractal up to stage 4 either on gre 
computer screen and show that the area bounded by the true fractal A ,, is 


2 V3 


Aw = — units”. 
5 


The inverted Koch snowflake is constructed in the same way as in Exercis 
curve is adjoined to the inner edges of an equilateral triangle. Construct th 
4 on graph paper or stage 6 on the computer. 


` Consider Pascal’s triangle given below. Cover the odd numbers with small bla 
the numbers). What do you notice about the pattern obtained? 


1 5 10 10 5 1 
1 6 15 20 15 6 1 
1 7 21 35 35 21 7 al 
1 8 28 56 70 56 28 8 1 
1 9 36 84 126 126 84 36 9 
1 10 45 120 210 252 210 120 45 1 


1 11 55 165 330 462 462 330 165 55 


1 12 66 220 495 792 924 792 495 220 € 

1 13 78 286 715 xO x1 x1 xO 715 28¢ 

1 14 91 364 x2 xX3 x4 x5 X4 X3 x2 ¢ 
1 15 105 455 x6 x7 x8 X9 X9 X8 X7 XE 


where x0 = 1287, x1 = 1716, x2 = 1001, x3 = 2002, x4 = 3003, x5 = 3432, . 
3003, x8 = 5005, and x9 = 6435. 


The Sierpinski triangle can be constructed by removing the central inverted eq 
from an upright triangle; a motif is given in this chapter. Construct the Sierpin 
stage 4 on graph paper using this method. 


A Sierpinski square is constructed by removing a central square at each stage. 
up to stage 3 and determine the fractal dimension of the theoretical object gent 


` Use the box-counting algorithm to approximate the fractal dimension of Barns 
Python program for plotting the fern is given in Section 17.5. 
. Consider the map defined by x,,,,; = f (xn), where f(x) is defined by 


— 4x x< 


ji 
rofa x> 


Plot the function on graph paper. Consider the sets, S „ say, which remain in tl 


NIN 


n iterations. List the intervals in S , and S 5. The set of points that never escape 
[0, 1] form a Cantor set. What is the fractal dimension of this Cantor set? 


Plot t(q) curves, D q, and f(a) spectra for the multifractal Cantor set 
described in Example 1 when (i) p; = 1 and p, = L, Gi) p; = 1 and 


= 3 iii 2 _ 3 
pr = and (iii) p, = z and p, = 2. 


10. 


P| P2 


Figure 17.20 The motif used to construct the Koch curve multifractal, where 2p 4 + 2p 9 = 1. 


P| PI 


Figure 17.21 The motif used to construct the Koch curve multifractal, where 3p 4 + 2p 9 = 1. 


P| P4 


Figure 17.22 The motif used to construct the Koch curve multifractal, where p 1 +p 2+p3+p4q4 
=1. 


A multifractal Koch curve is constructed and the weight is distributed as 
depicted in Figure 17.20. Plot the f(a) spectrum when Pi = 1 and p, = T 


A multifractal square Koch curve is constructed and a weight is distributed 
as depicted in Figure 17.21. Plot the t(q) curve, the D ,, and f(a) spectra 


when pı — l and p2 — L. 


A multifractal Koch curve is constructed and a weight is distributed as 
depicted in Figure 17.22, where p 4 + P> +p 3+ p 47= 1. Determine a, and 


fs- 
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18. Image Processing with Python 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


To provide a tutorial guide to image processing. 
To show how to manipulate images. 

To provide tools to analyze images. 

To introduce fast Fourier transforms. 


On completion of this chapter, the reader should be able to 


load and save images; 

perform analysis on color, grayscale, and black and white images; 
plot power spectra of discrete and continuous dynamical systems; 
perform simple image processing. 


Scikit-image is a collection of algorithms for image processing and is packaged 
with Anaconda. It includes algorithms for analysis, color space manipulation, 
feature detection, filtering, geometric transformations, morphology, 
segmentation, and more. It is designed to interoperate with the Python numerical 
and scientific libraries NumPy and SciPy. For more information, the reader is 
directed to: http://scikit-image.org 

OpenCV (Open Source Computer Vision Library) is a computer vision 
library while Pillow (the Python Imaging Library) is an image manipulation and 
processing library. For more information on OpenCV, the reader is directed to 
[1], and for more details on Pillow and SciPy, the reader is directed to reference 
[12]. 


18.1 Image Processing and Matrices 


There is extensive online documentation accompanying image processing and 
analysis with Python. Probably the most popular image processing textbooks 
specializing to date are [8, 10], and [13], whereas [2] and [14] specialize in bio- 
signal and medical image processing. Image processing books based on Python 
include [5] and [15]. 

The reader will be shown how to read and write image files and perform 
image processing techniques on those images. As a simple introduction, let us 
construct a multifractal image (see Chapter 17) using a simple motif. 


Example 1. | Construct an image of a multifractal lattice using the motif 
displayed in Figure 18.1(a) and save the image as a png file. 


Solution. The Python program for producing Figure 18.1(b) is listed as 
Programs 18a below. 


# Program 18a: Generating a multifractal image. 
# Save the image. 
# See Figure 18.1(b). 


import numpy as np 
import matplotlib.pyplot as plt 
from skimage import exposure, io, img_as_uint 


p1, p2, p3, p4 = 0.3, 0.4, 0.25, 0.05 


p=[[p1, p2], [p3, p4]] 
for k in range(1, 9, 1): 
M = np.zeros([2**(k + 1), 2**(k + 1)]) 
M.tolist() 
for 1 in range(2**k): 
for j in range(2**k): M[i][j] = p4 * p[i] 
[j] 
M[i][j + 2**k] = p2 * p[i][j] 
M[i + 2**k][j] = p3 * p[i][j] 
M[i + 2**k][j + 2**k] = p4 * p[i][j] 


# Plot the multifractal image. 

M = exposure.adjust_gamma(M, 0.2) 
plt.imshow(M, cmap=’gray’, interpolation=’nearest’ ) 

# Save the image as a portable network graphics (pn 
g) image. 

im = np.array(M, dtype = ‘’float64’) 
im = exposure.rescale_intensity(im, out_range = ’float 
’) im = img_as_uint(im) 

i10.imsave(’Multifractal.png’, im) io.show() 
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Figure 18.1 [Python] (a) A weight distribution motif; (b) the multifractal image. The weights are related 
to the grayscale , for example, p 1 = 1 would be white and p 4 = 0 would be black on this scale. 


Without changing the exposure, you will note that the value of most pixels is 
close to zero and this is why the screen initially looks black. The result, after 
changing the exposure, is shown in Figure 18.1(b). The image is a 512 x 512 
pixel image. Note that the coordinate system used in image processing is ordered 
from top to bottom and from left to right from the top left corner of the image. 
As the reader moves the mouse across the image in Python the coordinate 
position and the grayscale pixel values are displayed at the bottom of the figure 
window. To compute the pixel value at a coordinate position (x = 10, y = 10) (the 
pixel is near the top left corner of the image), one types >>>M[10,10], and this 


gives the pixel value 0. 055918789097870264. To save the image, use the 
>>>io.imsave command. 

A truecolor image, or RGB image, is an image in which each pixel is 
defined by three numerical values for Red, Green, and Blue. Python stores 
truecolor images as m X n x 3 arrays. Suppose that one wanted to establish the 
number of colored pixels in a color image. A simple program is listed below. 
The image, face, of a raccoon can be downloaded from scipy.misc and is shown in 
Figure 18.2(a). 


Example 2. Use Python to determine the number of white pixels in the image 
displayed in Figure 18.2(a). 


Solution. The program for computing the number of white pixels in 
image 18.2(a) is listed below. It is shown that there are 61248 white pixels. 


# Program 18b: Counting white pixels in a color pic 
ture of a raccoon. 
# See Figure 18.2. 


from scipy import misc 
import matplotlib.pyplot as plt import numpy as np 
face = misc.face() 


figi = plt.figure() 
plt.imshow( face) 
width, height, _ = face.shape 


print(’RGB value=’, face[100,100]) # RGB values of 
pixel. 
print(’Image dimensions: {}x{}’.format(width, heigh 
t)) white_pixels = np.zeros((width, height) ) 


def white_pixel_filter(pixel, threshold): 
return 1 if all(value > threshold for value in pixel) 
else 0 


for 1, row in enumerate(face): 
for j, pixel in enumerate(row): 
white_pixels[i, j] = white_pixel_filter(pixel, thresho 
1d=180) 


fig2 = plt.figure() 

plt.imshow(white_pixels, cmap = ‘gray’ ) 
print(’There are {:,} white pixels’ .format(int(np.sum( 
white_pixels)))) plt.show() 


Dimensions= (768, 1024, 3) 
RGB value= [94 82 92] 
There are 61248 white pixels. 
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Figure 18.2 [Python] Using Python to binarize a color image. (a) The image face of a raccoon. (b) The 
white pixels computed using Programs 18b. There are 61248 white pixels. 


To compute the dimensions of the image, use the command >>>face.shape. 


The dimensions of the face image are (768, 1024, 3). To compute the RGB pixel 
value at coordinate (100, 100), (here x = 100 (going left to right) and y = 100 
(going top to bottom)) one uses the command >>>face[100,100], which gives 
the RGB value [94, 82, 92]. To determine the data type of the image, type 


>>>face.dtype. The data type is uint8 , and the pixel values cannot be above 2° - 
1. 

The next example demonstrates how one may obtain a binary image from a 
grayscale image and how to apply some statistical analysis to the image. 


Example 3. Load the file Microbes.png and convert the grayscale image into a 
binary image. Determine the centroids and edges of the clusters, and plot a 
histogram of the areas of the clusters. 


Solution. The Python program for producing Figures 18.3 and 18.4 is listed as 
Programs 18c below. 


# Program 18c: Image and statistical analysis on th 
e image Microbes.png. 
# See Figures 18.3 and 18.4. 


import matplotlib.pyplot as plt 
from skimage import io 

import numpy as np 

from skimage.measure import regionprops 
from scipy import ndimage 

from skimage import feature 


microbes_img = 10.imread(’Microbes.png’ ) 
figi = plt.figure() 

plt.imshow(microbes_img, cmap=’gray’, interpolation= 
‘nearest’) width, height, = microbesimg.shape 
binary = np.zeros((width, height) ) 


for i, row in enumerate(microbes_img): 
for j, pixel in enumerate(row): if pixel[0] > 80: 
binary[i, j] = 1 


fig2 = plt.figure() 
plt.imshow(binary, cmap=’gray’ ) 


print(’There are {:,} white pixels’ .format(int(np.sum( 
binary)))) 


blobs = np.where(binary>0.5, 1, 0) 
labels, no_objects = ndimage.label(blobs) 
props = regionprops(blobs) 

print(’There are {:,} clusters of cells:’.format(no 
_objects)) 


fig3 = plt.figure() 
edges=feature.canny(binary, Sigma=2, low_threshold=0. 
5) plt.imshow(edges, cmap=plt.cm.gray) 


fig4 = plt.figure() 

labeled_areas = np.bincount(labels.ravel())[1: ] 

print(labeled_areas) 

plt.hist(labeled_areas, bins=no_objects) 
plt.xlabel(’Area’, fontsize=15) 
plt.ylabel(’Number of clusters’, fontsize=15) 
plt.tick_params(labelsize=15) plt.show() 


Figure 18.3(a) shows the original image, Microbes.png, taken with a 
scanning microscope. The image is converted into a grayscale image using the 
rgb2gray command. A filter is then applied to this image and pixels are assigned 
values “0” or “1,” to give the binary image displayed in Figure 18.3(b). The 
centroids of the clusters of cells are marked with red dots in Figure 18.3(c); this 
is left as an exercise for the reader. Finally, Figure 18.3(d) shows the edges of 
the clusters using a canny edge detector. More detail on binarizing images, edge 
detection, filtering, and regionprops can be found in the image processing 
textbooks listed in the bibliography. 

Figure 18.4 shows a histogram of the areas of the clusters of microbes using 
the data from Figure 18.3(b). The area of the clusters is given as the number of 
white pixels in the cluster. 
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Figure 18.3 [Python] (a) The image Microbes.png. (b) A binary image of Microbes.png. (c) The centroids 
of the microbes clusters are shown as red dots. (d) The edges of the clusters. 
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Figure 18.4 [Python] Histogram of the areas of the clusters. There are 106 clusters. 


18.2 The Fast Fourier Transform 


The Fourier transform is a mathematical transform with many applications in 
image processing, mathematics, engineering, and the physical sciences. 


Definition 1. 
The continuous Fourier transform is defined by 


oe) 


F(w) = ihe "dr 


—00 


which transforms a mathematical function of time, f(t), into a function of 
frequency, F(œw). The new function is the Fourier transform or the Fourier 
spectrum of the function f. 


Definition 2. 
The inverse Fourier transform is defined by 


f= { i F(w)e dw. 
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into a continuous spectrum of an infinite number of sinusoidal curves. In many 
physical applications, scientists deal with discretely sampled signals, usually at 
constant intervals. For such data, the discrete Fourier transform is appropriate. 


Definition 3. 
The discrete Fourier transform and its inverse for vectors of length N are defined 
by 


N 
X, = » oe 
n=1 


and 
Ly need 
C= N » XW ; 
k=1 
where 
wy = eN 


and each X ; is a complex number that encodes both amplitude and phase of a 
sinusoidal component of function x ņ„. 


A fast Fourier transform, or FFT, is an algorithm to compute the discrete Fourier 
transform. The FFT was first discovered by Gauss in 1805 but the modern 
incarnation is attributed to Cooley and Tukey [6] in 1965. Computing a set of N 
data points using the discrete Fourier transform requires ¢ ( N?) arithmetic 


operations, while an FFT can compute the same discrete Fourier transform in 
only O(NlogN) operations. 

FFT is a powerful signal analysis tool, applicable to a wide variety of fields 
including acoustics, applied mechanics, communications, digital filtering, 
instrumentation, medical imaging, modal analysis, numerical analysis, 
seismography, and spectral analysis. 


Example 4. A common use of Fourier transforms is to find the frequency 
components of a signal buried in a noisy time domain signal. Consider data 
sampled at 800Hz. Form a signal containing a 50Hz sinusoid of amplitude 0. 7 
and 120Hz sinusoid of amplitude 1 and corrupt it with some zero-mean random 


noise. Use Python to plot a graph of the signal and write a program that plots an 
amplitude spectrum for the signal. 


Solution. Figure 18.5(a) shows the sum of a 50Hz sinusoid and a 120Hz sinusoid 
corrupted with zero-mean random noise and 18.5(b) displays the amplitude 
spectrum of y(t). The program for plotting the figures is listed below. 
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Figure 18.5 [Python] (a) Signal corrupted with zero-mean random noise. (b) The amplitude spectrum of 


y(t). You can read off the amplitude and frequencies. 


# Program 18d: Fast Fourier transform of a noisy si 
gnal. 

# See Figure 18.5. 

import numpy as np 

import matplotlib.pyplot as plt 
from scipy.fftpack import fft 


Ns = 1000 # Number of sampling points 

Fs = 800 # Sampling frequency T = 1/Fs # Sample time 
t = np.linspace(0, Ns*T, Ns) amp1, amp2 = 0.7, 1 
freqi, freq2 = 50, 120 


# Sum a 50Hz and 120 Hz sinusoid 
x = amp1 np.sin(2np.pi fregit) + amp2*np.sin(2*np.pi 
freq2t) y = x + 0.5*np.random.randn(Ns) 
figi = plt.figure() 
plt.plot(t, y) 
plt.xlabel(’Time (ms)’, fontsize=15) 
plt.ylabel(’y(t)’, fontsize=15) 
plt.tick_params(labelsize=15) 


fig2 = plt.figure() 

yf = fft(y) 

xf = np.linspace(0, 1/(2*T), Ns//2) 
plt.plot(xf, 2/Ns * np.abs(yf[O:Ns//2]) ) 
plt.xlabel(’Frequency (Hz)’, fontsize=15) 
plt.ylabel(’$|Y(f)|$’, fontsize=15) 
plt.tick_params(labelsize=15) plt.show() 


Readers interested in signal processing with Python are directed to references 
[4] and [16]. The next example illustrates an application of FFT for finding the 
power spectra of time series data. Interested readers should consult Melbourne 
and Gottwald [11], who present results on the broadband nature of power spectra 
for diverse classes of discrete dynamical systems. For many years, the power 
spectrum has been used to distinguish periodic, quasiperiodic, and chaotic 
motions of certain dynamical systems from a broad range of fields. The power 
spectrum plotted for a periodic or quasiperiodic signal has discrete peaks at the 
harmonics and subharmonics, while the chaotic signal has a broadband 


component in its power spectrum. In order to illustrate these phenomena 
consider the following simple example. 
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Figure 18.6 [Python] Iterative plots and power spectra for system (18.1). (a) Periodic behavior when £ = 
0. 05. (b) Power spectrum when £f = 0. 05. (c) Quasiperiodic behavior when £ = 0. 12. (d) Power spectrum 
when £ = 0. 12. (e) Chaotic behavior when £ = 0. 3. (f) Power spectrum when £ = 0. 3. 


Example 5. 
Consider the 2-dimensional discrete map defined by 
2 
Mint = 1 +px,- ay; 
Yn+1 = Ans 


(18.1) 
where a and f are constants. Suppose that a = 1, plot iterative plots and power 
spectra for system (18.1) when (i) 6 = 0. 05; (ii) p = 0. 12, and (iii) B = 0. 3. 


Solution. The Python program for producing the plots in Figure 18.6 is listed 
below. 


# Program 18e: Iterative map and power spectra. 
# See Figure 18.6. 


import matplotlib.pyplot as plt 
from scipy.fftpack import fft import numpy as np 


# Parameters 
a, b =1, 0.3 # To get Figures 18.6(e) and (f) 
n = 50000 


def map_2d(X): 


X, y = X 
xn = 1 - a*y**2 + b*x 
yn = X 


return (xn, yn) 


XO = [(1 - b) 2, (1 - b) 2] 
X, Y= [], [] 

for 1 in range(n): 

xn, yn = map_2d(X0) 

X, Y =X + [xn], Y + Lyn] 
XO = [xn, yn] 


fig, ax = plt.subplots(figsize=(8, 8)) 
ax.scatter(X, Y, color="blue’, s=0.05) 
plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 


fig2 = plt.figure() 

f = np.linspace(-1, 1, n) 

power np.abs(fft(X)**2) 

power np. log( power ) 

plt.plot(f, power) 

plt.xlim(0, 1) 

plt.xlabel(’Frequency (Hz)’, fontsize=15) 
plt.ylabel(’log(Power)’, fontsize=15) 
plt.tick_params(labelsize=15) plt.show() 


18.3 The Fast Fourier Transform on Images 


Among the many applications of the two-dimensional Fourier transform there 
are some very interesting and useful image processing tools which include image 
compression, blurring and de-blurring, sharpening, noise removal, and edge 
detection, for example. Figure 18.7 depicts how to apply a low pass filter to a 
jpeg image of Lena, and a Python program to produce a fast Fourier transform is 
listed below. Note that the ideal low pass filter applies a Gaussian function 
(interested readers should consult some of the textbooks in the reference section 
of this chapter for more details). A low pass filter is used to compress an image . 
A high pass filter (where the circular region would be colored black in 

Figure 18.7(c)) is used in edge detection (Figure 18.8). 


Figure 18.7 [Python] Low pass filtering of the Lena image. (a) Lena.jpg, (b) fast Fourier transform, (c) a 
circular low pass filter, and (d) a compressed image of Lena. Use the Python help pages for function 
definitions and syntax. 


# Program 18f: Fast Fourier transform of the Lena i 
mage. 
# See Figure 18.7. 


import numpy as np 

import skimage.io as io 

import pylab 

import matplotlib.pyplot as plt 
from skimage.color import rgb2gray 


lena = rgb2gray(io.imread(’lena.jpg’ )) 


figi = plt.figure() 
plt.imshow(lena, cmap=’gray’ ) 


fig2 = plt.figure() 

# Take the 2- 
dimensional DFT and centre the frequencies 
ftimage = np.fft.fft2(lena) 

ftimage = np.fft.fftshift(ftimage) 
ftimage = np.abs(ftimage) 

fftimage np.log(ftimage ) 

fftimage rgb2gray(fftimage) 
pylab.imshow(fftimage, cmap=’gray’) plt.show() 


The final example illustrates the Roberts and Sobel edge detection 
algorithms. The Python program for producing Figure 18.8 is listed below. 


# Program 18g: Edge detection on the Lena image. 
# See Figure 18.8. 


import matplotlib.pyplot as plt 
import skimage.io as io 

from skimage.filters import roberts, sobel 
from skimage.color import rgb2gray 


lena = rgb2gray(io.imread(’lena.jpg’ )) 


edge_roberts = roberts(lena) 
edge_sobel = sobel(lena) 


fig, ax = plt.subplots(ncols=2, sharex=True, sharey 
=True, figsize=(8, 4)) 


ax[0].imshow(edge_roberts, cmap=plt.cm.gray) 
ax[0].set_title(’Roberts Edge Detection’) 


ax[1].imshow(edge_sobel, cmap=plt.cm.gray) 
ax[1].set_title(’Sobel Edge Detection’) 


for a in ax: 
a.axis(’off’) 


plt.tight_layout( ) 
plt.show( ) 


Roberts Edge Detection Sobel Edge Detection 


Figure 18.8 [Python] Edge detection in the Lena image using both Roberts and Sobel edge detection. 


18.4 Exercises 


1. 


Use the matrix motif M = [0. 1, 0. 2; 0. 2, 0. 5] to produce a multifractal 
image up to stage 8. Use Python to produce a figure representation of the 
multifractal. 


Use the matrix M = [0. 1, 0. 2, 0. 05; 0. 2, 0. 05, 0. 01; 0. 3, 0. 04, 0. 05] to 
produce a multifractal image up to stage 5. Use Python to produce a figure 
representation of the multifractal. 


Use Python to produce a binary image of the green pixels in face (see 
Figure 18.2(a)). Determine an approximate number of green pixels. 


Write a Python program to plot the centroids of the Microbes.png image 
(see Figure 18.3). 


. Compute the first 10000 iterates of the logistic map 


Xn+1 = 4x, (l = Žr): 


given that x ọ = 0. 1. Use Python to plot a power series spectrum. 


. Compute the first 10000 iterates of the Gaussian map 


oe 
Xn+1 = € Stn 0.6, 


given that x ọ = 0. 1. Use Python to plot a power series spectrum. 


Compute the first 10000 iterates of the Hénon map 
Xnr = 1+ Ya 1.2%, Your = 0.4% 


given that x o = 0. 1, y ọ = 0. Use Python to plot a power series spectrum. 


Compute the first 10000 iterates of the minimal chaotic neuromodule 


Xne1 = 2+ 3.56) (Xn) m 4p (Yn) » Yml = J+ Sh (Xn) > 
where #)(x) = ¢2(x) = 1/ (1 + e™), given that x 9 = 1, y 9 = 0. Use 


Python to plot a power series spectrum. 


Write Python programs to produce (i) a circular high pass filter of the 
Lena.jpg image (used for edge detection); (ii) an ideal low pass filter of the 
Lena.jpg image using a suitable Gaussian function. 


10. 
Carry out your own research to find other high pass filters used for edge 


detection on images. 
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19. Chaos Control and Synchronization 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To provide a brief historical introduction to chaos control and 
synchronization. 

e To introduce two methods of chaos control for one-and two-dimensional 
discrete maps. 

e To introduce two methods of chaos synchronization. 


On completion of this chapter, the reader should be able to 


control chaos in the logistic and Hénon maps; 
plot time series data to illustrate the control; 
synchronize chaotic systems; 

appreciate how chaos control and synchronization are being applied in the real 
world. 


This chapter is intended to give the reader a brief introduction into the new 
and exciting field of chaos control and synchronization and to show how some 
of the theory is being applied to physical systems. There has been considerable 
research effort into chaos control in recent times, and practical methods have 
been applied in, for example, biochemistry, cardiology , communications, 
physics laboratories, and turbulence . Chaos control has been achieved using 
many different methods, but this chapter will concentrate on two procedures 
only. Chaos synchronization has applications in analog or digital 
communications and cryptography. For more background material on chaos 
control, the reader is directed to references [6, 8, 10, 12, 13, 15, 19, 21, 23, 24], 
and [25]. The other references are predominantly concerned with chaos 
synchronization. 

Control and synchronization of chaotic systems are possible for both discrete 


and continuous systems. Analysis of chaos control will be restricted to discrete 
systems in this chapter and synchronization will be restricted to continuous 
systems. 


19.1 Historical Background 


Even simple, well-defined discrete and continuous nonlinear dynamical systems 
without random terms can display highly complex, seemingly random behavior. 
Some of these systems have been investigated in this book, and mathematicians 
have labeled this phenomenon deterministic chaos . Nondeterministic chaos , 
where the underlying equations are not known, such as that observed in a lottery 
or on a roulette wheel, will not be discussed in this text. Throughout history, 
dynamical systems have been used to model both the natural and technological 
sciences. In the early years of investigations, deterministic chaos was nearly 
always attributed to random external influences and was designed out if possible. 
The French mathematician and philosopher Henri Poincaré laid down the 
foundations of the qualitative theory of dynamical systems at the turn of the 
century and is regarded by many as being the first chaologist . Poincaré devoted 
much of his life in attempting to determine whether or not the solar system is 
stable. Despite knowing the exact form of the equations defining the motions of 
just three celestial bodies, he could not always predict the long-term future of the 
system. In fact, it was Poincaré who first introduced the notion of sensitivity to 
initial conditions and long-term unpredictability. 

In recent years, deterministic chaos has been observed when applying simple 
models to cardiology, chemical reactions, electronic circuits, laser technology, 
population dynamics, turbulence, and weather forecasting. In the past, scientists 
have attempted to remove the chaos when applying the theory to physical 
models, and it is only since 1990 that they have come to realize the potential 
uses for systems displaying chaotic phenomena. For some systems, scientists are 
replacing the maxim “stability good, chaos bad” with “stability good, chaos 
better.” It has been found that the existence of chaotic behavior may even be 
desirable for certain systems. 

Since the publication of the seminal paper of Ott, Grebogi, and Yorke [21] in 
1990, there has been a great deal of progress in the development of techniques 
for the control of chaotic phenomena. Basic methods of controlling chaos along 
with several reprints of fundamental contributions to this topic may be found in 
the excellent textbooks of Kapitaniak [13, 14]. Some of these methods will now 
be discussed very briefly, and then a selection of early applications of chaos 
control in the real world will be listed. 


Il. 


Il. 


IV. 


Changing the systems parameters . The simplest way to suppress chaos is 
to change the system parameters in such a way as to produce the desired 
result. In this respect, bifurcation diagrams can be used to determine the 
parameter values. For example, in Chapter 5, bifurcation diagrams were 
used to determine regions of bistability for nonlinear bistable optical 
resonators. It was found that isolated bistable regions existed for only a 
narrow range of parameter values. However, the major drawback with this 
procedure is that large parameter variations may be required, which could 
mean redesigning the apparatus and changing the dimensions of the 
physical system. In many practical situations, such changes are highly 
undesirable. 


Applying a damper . A common method for suppressing chaotic 
oscillations is to apply some kind of damper to the system. In mechanical 
systems, this would be a shock absorber, and for electronic systems, one 
might use a shunt capacitor. Once more, this method would mean a large 
change to the physical system and might not be practical. 


Pyragas’ method . This method can be divided into two feedback 
controlling mechanisms: linear feedback control and time-delay feedback 
control. In the first case, a periodic external force is applied whose period 
is equal to the period of one of the unstable periodic orbits contained in the 
chaotic attractor. In the second case, self-controlling delayed feedback is 
used in a similar manner. This method has been very successful in 
controlling chaos in electronic circuits such as the Duffing system and 
Chua’s circuit . A simple linear feedback method has been applied to the 
logistic map in Section 19.2. 


Stabilizing unstable periodic orbits (the Ott, Grebogi, and Yorke (OGY) 
method ). The method relies on the fact that the chaotic attractors contain 
an infinite number of unstable periodic orbits. By making small time- 
dependent perturbations to a control parameter of the system, it is possible 
to stabilize one or more of the unstable periodic orbits. The method has 
been very successful in applications but there are some drawbacks. This 
method will be discussed in some detail at the end of this section. 


Occasional proportional feedback (OPF) . Developed by Hunt [12] in 
1991, this is one of the most promising control techniques for real 
applications. It is a one-dimensional version of the OGY method and has 


been successful in suppressing chaos for many physical systems. The 
feedback consists of a series of kicks, whose amplitude is determined from 
the difference of the chaotic output signal from a relaxation oscillation 
embedded in the signal, applied to the input signal at periodic intervals. 
VI. 
Synchronization . The possibility of synchronization of two chaotic 
systems was first proposed by Pecora and Carroll [22] in 1990 with 
applications in communications. By feeding the output from one chaotic 
oscillator (the transmitter) into another chaotic oscillator (the receiver), 
they were able to synchronize certain chaotic systems for certain parameter 
choices. The method opens up the possibilities for secure information 
transmission. More historical information and examples of chaos 
synchronization are presented in Section 19.4. 


Before summarizing the OGY method, it is worthwhile to highlight some of 
the other major results not mentioned above. The first experimental suppression 
of chaos was performed by Ditto, Rausseo, and Spano [8] using the OGY 
algorithm. By making small adjustments to the amplitude of an external 
magnetic field, they were able to stabilize a gravitationally buckled 
magnetostrictive ribbon that oscillated chaotically in a magnetic field. They 
produced period-one and period-two behavior, and the procedure proved to be 
remarkably robust. Using both experimental and theoretical results, Singer, 
Wang, and Bau [25] applied a simple on-off strategy in order to laminarize 
(suppress) chaotic flow of a fluid in a thermal convection loop. The on-off 
controller was applied to the Lorenz equations , and the numerical results were 
in good agreement with the experimental results. Shortly afterwards, Hunt [12] 
applied a modified version of the OGY algorithm called occasional proportional 
feedback (OPF) to the chaotic dynamics of a nonlinear diode resonator. Small 
perturbations were used to stabilize orbits of low period, but larger perturbations 
were required to stabilize orbits of high periods. By changing the level, width, 
and gain of the feedback signal, Hunt was able to stabilize orbits with periods as 
high as 23. Using the OPF algorithm developed by Hunt, Roy et al. [23] were 
able to stabilize a weakly chaotic green laser . In recent years, the 
implementation of the control algorithm has been carried out electronically using 
either digital signals or analog hardware. The hope for the future is that all- 
optical processors and feedback can be used in order to increase speed. The first 
experimental control in a biological system was performed by Garfinkel et al. 
[10] in 1992. They were able to stabilize arrhythmic behavior in eight out of 
eleven rabbit hearts using a feedback-control mechanism. It has been reported in 


[5] that a company has been set up to manufacture small defibrillators that can 
monitor the heart and deliver tiny electrical pulses to move the heart away from 
fibrillation and back to normality. It was also conjectured in the same article that 
the chaotic heart is more healthy than a regularly beating periodic heart. The 
OGY algorithm was implemented theoretically by the author and Steele [19] to 
control the chaos within a hysteresis cycle of a nonlinear bistable optical 
resonator using the real and imaginary parts of the electrical field amplitude. The 
same authors have recently managed to control the chaos using feedback of the 
electric field . This quantity is easy to continuously monitor and measure and 
could lead to physical applications in the future. 

Methods I-VI and results given above are by no means exhaustive. This 
section is intended to provide a brief introduction to the subject and to encourage 
further reading. 

The OGY Method 

Following the paper of Ott, Grebogi, and Yorke [21], consider the n- 
dimensional map 


Zn E f(Z,, p), 


(19.1) 
where p is some accessible system parameter that can be changed in a small 
neighborhood of its nominal value, say, p ọ. In the case of continuous-time 


systems, such a map can be constructed by introducing a transversal surface of 
section and setting up a Poincaré map . 
It is well known that a chaotic attractor is densely filled with unstable periodic 
orbits and that ergodicity guarantees that any small region on the chaotic 
attractor will be visited by a chaotic orbit. The OGY method hinges on the 
existence of stable manifolds around unstable periodic points. The basic idea is 
to make small time-dependent linear perturbations to the control parameter p in 
order to nudge the state towards the stable manifold of the desired fixed point. 
Note that this can only be achieved if the orbit is in a small neighborhood, or 
control region , of the fixed point. 

Suppose that Z (p) is an unstable fixed point of equation (19.1). The 


position of this fixed point moves smoothly as the parameter p is varied. For 
values of p close to p ọ ina small neighborhood of Z <(p o), the map can be 


approximated by a linear map given by 
Zn+1 — Zs (Po) = J(Zn - Zs (Po)) + C(p — po), (19.2) 


where J is the Jacobian and Ç = a. All partial derivatives are evaluated at 
p 


Z s(P o) and p o. 
Assume that in a small neighborhood around the fixed point 


p — Po = -K(Z, — Zs (po)), (19.3) 


where K is a constant vector of dimension n to be determined. Substitute 
(19.3) into (19.2) to obtain 


Zn+1 = Zs (po) = (J E CK)(Z, ~~ Zs (po)). 


(19.4) 
The fixed point is then stable as long as the eigenvalues, or regulator poles , 
have modulus less than unity. The pole-placement technique from control theory 
can be applied to find the vector K. A specific example is given in Section 19.3. 
A simple schematic diagram is given in Figure 19.1 to demonstrate the action of 
the OGY algorithm. Physically, one can think of a marble placed on a saddle. If 
the marble is rolled towards the center (where the fixed point lies), then it will 
roll off as depicted in Figure 19.1(a). If, however, the saddle is moved slightly 
from side to side, by applying small perturbations, then the marble can be made 
to balance at the center of the saddle, as depicted in Figure 19.1(b). 


a 


Z Zm+2 


m+1 


Figure 19.1 Possible iterations near the fixed point (a) without control and (b) with control. The double 
ended arrows are supposed to represent small perturbations to the system dynamics. The iterates Zz; 


represent perturbed orbits. 


Some useful points to note: 


e The OGY technique is a feedback-control method. 

e If the equations are unknown, sometimes delay-coordinate embedding 
techniques using a single variable time series can be used (the map can be 
constructed from experimental data). 

e There may be more than one control parameter available. 

e Noise may affect the control algorithm. If the noise is relatively small the 
control algorithm will still work in general. 


It should also be pointed out that the OGY algorithm can only be applied 
once the orbit has entered a small control region around the fixed point. For 
certain nonlinear systems the number of iterations required—and hence the time 
—for the orbit to enter this control region may be too many to be practical. 
Shinbrot et al. [24] solved this problem by targeting trajectories to the desired 
control regions in only a small number of iterations. The method has also been 
successfully applied in physical systems. 


19.2 Controlling Chaos in the Logistic Map 


Consider the logistic map given by 
Xn+1 = Falin) = HUXn(l =a) (19.5) 


as introduced in Chapter 14 There are many methods available to control the 
chaos in this one-dimensional system, but the analysis is restricted to periodic 
proportional pulses in this section. For more details on the method and its 
application to the Hénon map the reader is directed to [6]. To control the chaos 
in this system, instantaneous pulses will be applied to the system variables x „ 


once every p iterations such that 
Xj — is 


where k is a constant to be determined and p denotes the period. 
Recall that a fixed point of period one , say, x s, of equation (19.5) satisfies the 


equation 
Xs = fulxs), 


and this fixed point is stable if and only if 


<1. 


dfa(xs) 
dx 


Define the composite function F (x) by 
F(x) = ki): 


A fixed point of the function F ,, satisfies the equation 


ki Os) axe (19.6) 
where the fixed point x g is stable if 
dfa (xs) 
k— = I, 
| Jx (19.7) 


Define the function C P(x) by 


x Of, Gs) 


Pf ay 
a Pox) dx 


Substituting from (19.6), equation (19.7) becomes 
IC? (xs)| < 1. 


(19.8) 
A fixed point of this composite map is a stable point of period p for the original 
logistic map when the control is switched on, providing condition (19.8) holds. 
In practice, chaos control always deals with periodic orbits of low periods, say, p 
= 1 to 4 and this method can be easily applied. 

To illustrate the method, consider the logistic map when p = 4 and the system is 
chaotic. The functions C t(x), C ?(x), C 3(x), and C (x) are shown in Figure 19.2. 
Figure 19.2(a) shows that fixed points of period one can be stabilized for 

every x ¢ in the range between zero and approximately 0.67. When p = 2, 


Figure 19.2(b) shows that fixed points of period two can only be stabilized in 
three ranges of x ç values. Figures 19.2(c) and (d) indicate that there are seven 


and 14 acceptable ranges for fixed points of periods three and four, respectively. 
Notice that the control ranges are getting smaller and smaller as the periodicity 
increases. 

Figure 19.3 shows time series data for specific examples when the chaos is 


controlled to period-one, period-two, period-three, and period-four behavior, 
respectively. 

The values of x < chosen in Figure 19.3 were derived from Figure 19.2. The 
values of k were calculated using equation (19.6). Note that the system can be 
stabilized to many different points on and even off the chaotic attractor (see the 
work of Chau [6]). A Python program is listed in Section 19.5. 

This method of chaos control by periodic proportional pulses can also be 
applied to the two-dimensional discrete Hénon map. The interested reader is 
again directed to [6]. The OGY algorithm will be applied to the Hénon map in 
the next section. 


19.3 Controlling Chaos in the Henon Map 


Ott, Grebogi, and Yorke [21] used the Hénon map to illustrate the control 
method. A simple example will be given here. Consider the Hénon map as 
introduced in Chapter 14 The two-dimensional iterated map function is given by 


Xm = 1+ Yp- 0X}, Ypm1 = BXns 
(19.9) 
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Figure 19.2 Control curves C i i = 1, 2, 3, 4, for the logistic map when p = 4. The range is restricted to — 1 


< CP(x s) < 1 in each case. 
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Figure 19.3 [Python] Stabilization of points of periods one, two, three, and four for the logistic map when 
H = 4; (a) x s5 = 0. 4, k = 0. 417; (b) x 5 = 0.2, k= 0. 217; (c) x 5 = 0.3, k = 0. 302; and (d) x 5 = 0.6, k=0. 
601. In each case k is computed to three decimal places. 


where a > 0 and | £ | < 1. Take a transformation x, = 1 , and y = £y, then 
a a 


system (19.9) becomes 


_ ee 23 
Xn+1 = @ + BYn — Xw Yn+1 = Xn. 


(19.10) 

The proof that system (19.9) can be transformed into system (19.10) will be left 
to the reader in the exercises at the end of this chapter. The Hénon map is now in 
the form considered in [21], and the control algorithm given in Section 19.1 will 
now be applied to this map. Set f = 0. 4 and allow the control parameter, in this 
case a, to vary around a nominal value, say, @ ọ = 1. 2, for which the map has a 


chaotic attractor. 
The fixed points of period one are determined by solving the simultaneous 
equations 


œo +ßy-x -x=0 and x-y=0. 


In Chapter 14, it was shown that the Hénon map has two fixed points of period 
one if and only if (1 —B)? + 4a ọ > 0. In this particular case, the fixed points of 
period one are located approximately at A = (x 14, Y 1,1) = (0. 8358, 0. 8358) and 
B = (x 12 Y 1,2) = (1. 4358, —1. 4358). The chaotic attractor and points of period 
one are shown in Figure 19.4. 


yo 
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Figure 19.4 Iterative plot for the Hénon map (3000 iterations) when a ọ = 1. 2 and f = 0. 4. The two fixed 
points of period one are labeled A and B. 


The Jacobian matrix of partial derivatives of the map is given by 
OP OP 
Ox dy 

where P(x, y) = a 9 + By — x2 and Q(x, y) = x. Thus 


_4 =2x p 
jaf 8 


Consider the fixed point at A; the fixed point is a saddle point. Using the notation 
introduced in Section 19.1, for values of a close to a 9 in a small neighborhood 


of A, the map can be approximated by a linear map 


Zn+1 — Zs (ao) = J(Zn — Zs (ao)) + Cla — a), 


(19.11) 
where Z „= (X py n)’, A= Z (a o), J is the Jacobian, and 


oP 
Ow 
and all partial derivatives are evaluated at a ọ and Z <(a 9). Assume in a small 


neighborhood of A, 
a — a = -K(Z, — Zs(a)), (19.12) 


_{ 
Substitute (19.12) into (19.11) to obtain 
Zn+1 — Zs (ao) = (J — CK)(Z, — Zs (a0)). 


Therefore, the fixed point at A = Z ¿(a 9) is stable if the matrix J -CK has 


eigenvalues (or regulator poles) with modulus less than unity. In this particular 
case, 


where 


J—-CKx — -kı =~ k2 


and the characteristic polynomial is given by 
A? + A(1.671563338 + kı) + (ky — 0.4) = 0. 
Suppose that the eigenvalues (regulator poles) are given by A , and A 3; then 
AjAg =ky -0.4 and — (A; + a2) = 1.671563338 + kı. 


The lines of marginal stability are determined by solving the equations A į = +1 
and A , A, = 1. These conditions guarantee that the eigenvalues A į and A , have 
modulus less than unity. Suppose that A 4 A > = 1. Then 


ko = 1.4. 


Suppose that A , = +1. Then 
Ay =k-0.4 and ay = —2.671563338 — ky. 

Therefore, 

ky = —k, — 2.271563338. 
If à , =~—1, then 

Ay = —(ky - 0.4) and æ = —0.671563338 — kı. 

Therefore, 

ky = kı + 1.071563338. 


The stable eigenvalues (regulator poles) lie within a triangular region as depicted 
in Figure 19.5. 


Figure 19.5 The bounded region where the regulator poles are stable. 
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Figure 19.6 [Python] Time series data for the Hénon map with and without control, r p 2 


In case (a), the control is activated after the 199th iterate, and in case (b), the control is switched off after 
the 400th iterate. 


Select k 4 =-1.5 and k , = 0. 5. This point lies well inside the triangular region 
as depicted in Figure 19.5. The perturbed Hénon map becomes 


2 
Xn+1 = (—ki (Xn T X11) - ka(Yn = yi1) + a) + BYn Xn» Yni = Xn- 


(19.13) 

Applying equations (19.10) and (19.13) without and with control, 
respectively, it is possible to plot time series data for these maps. Figure 19.6(a) 
shows a time series plot when the control is switched on after the 199th iterate; 
the control is left switched on until the 400th iterate. In Figure 19.6(b), the 
control is switched on after the 199th iterate and then switched off after the 
400th iterate. Remember to check that the point is in the control region before 
switching on the control. If one attempts to switch on the control after the 200th 
iterate, an error results, as the 200th iterate is not in the control region. 

Once again, the Python program is listed in Section 19.5. 


19.4 Chaos Synchronization 


The first recorded experimental observation of synchronization is attributed to 
Huygens in 1665. Huygens was attempting to increase the accuracy of time 
measurement and the experiment consisted of two huge pendula connected by a 
beam. He recorded that the imperceptible motion of the beam caused mutual 
anti-phase synchronization of the pendula. Synchronization phenomena were 
also observed by van der Pol (1927) and Rayleigh (1945) when investigating 
radio communication systems and acoustics in organ pipes, respectively. For 
other interesting examples of synchronization without chaos the reader is 
directed to the excellent book of Strogatz [26]. 

This section is concerned with chaos synchronization, where two, or more, 
coupled chaotic systems (which may be equivalent or nonequivalent) exhibit a 
common, but still chaotic, behavior. Boccaletti et al. [4] present a review of the 
major methods of chaotic synchronization including complete synchronization, 
generalized synchronization, lag synchronization, phase, and imperfect phase 
synchronization. However, examples and theory of complete and generalized 
synchronization alone are presented here. The reader is directed to the textbooks 
[20] and [27] for more information. 


Since the pioneering work of Pecora and Carroll [22], the most popular area 
of study is probably in secure communications. Electronic and optical circuits 
have been developed to synchronize chaos between a transmitter and a receiver. 
Cuomo and Oppenheim [7] built electronic circuits consisting of resistors, 
capacitors, operational amplifiers, and analog multiplier chips in order to mask 
and retrieve a message securely. Optically secure communications using 
synchronized chaos in lasers were discussed by Luo et al. in [18]. More recently, 
many papers have appeared on chaos synchronization with cryptographic 
applications, see [16], for example. Other examples of chaotic synchronization 
can be found in chemical kinetics [17], physiology [11], neural networks [30], 
and economics [28]. 

Complete Synchronization 

Pecora and Carroll [22] consider chaotic systems of the form 


u = f(u), 


(19.14) 
where u € R” and f : R” — R”. They split system (19.14) into two 


subsystems, one the driver system and the other the response . 


d(x(t)) driver, 
r(y(t), x(t)) response, 


x 
y 


II 


where x e R$, y € R”, and k+ m =n. The vector x(t) represents the driving 


signal. Some of the outputs from the driver system are used to drive the response 
system. Consider the following simple example involving a Lorenz system (see 
Section 8.4). The driver Lorenz system is 


Xi = O(X2— X1), %2 = FX] — X2 — X1X3, X3 = X1X2 — Xs, 


(19.15) 
and the response is given by 


y2 = —X1y3 + 7X, — y2 Y3 = Xıy2 — by3. (19.16) 
Note that the response Lorenz system is a subsystem of the driver, and in this 


case x ,(t) is the driving signal. Choose the parameter values ø = 16, b = 4, and r 


= 45. 92, then the driver system (19.15) is chaotic. Pecora and Carroll [22] 
establish that synchronization can be achieved as long as the conditional 
Lyapunov exponents of the response system, when driven by the driver, are 


negative. However, the negativity of the conditional Lyapunov exponents gives 
only a necessary condition for stability of synchronization, see reference [4]. To 
prove stability of synchronization it is sometimes possible to use a suitable 
Lyapunov function (see Chapter 6). Suppose, in this case, that 


e = (22, x3) — (y2, y3) = error signal, 


(19.17) 
then we can prove that e(t) > 0 as t > œ, for any set of initial conditions for the 
coupled systems (19.15) and (19.16). Consider the following example: 


Example 1. 


Find an appropriate Lyapunov function to show that e(t) > 0 ast > œ, for the 
driver-response system (19.15) and (19.16). Use Python to show that the system 
synchronizes. 

Solution. The equations governing the error dynamics (19.17) are given by 


2 = —xı(t)ez — ez 
€3 = xez — bez. 


> 


Multiply the first equation by e 5 and the second equation by e 3 and add to give 
€7€7 + e363 = -e7 = be, 
and the chaos terms have cancelled out. Note that 
e262 + €363 = Lala 2) 
ae Dee ay 
Define a Lyapunov function 
PER. 
V(ez, e3) = 5 (e + e), 
then 
dV 2 2 
V(e2,e3) >0 and PT Se, = pe, <0, 
since b > 0. Therefore, V (e 4, e ») is a Lyapunov function and (e 5, e 3) = (0, 0) is 


globally asymptotically stable. A Python program for system (19.15) is listed in 
Section 19.5 and Figures 19.7(a) and (b) show synchronization of x 5(t) with y 


(t), and x 3(¢) with y 3(0). 

The choice of driving signal is crucial in complete synchronization, some 
conditional Lyapunov exponents can be positive. A different choice of driving 
signal can lead to unstable synchronized states, see [4], for example. An 
alternative coupling configuration that addresses this problem is the auxiliary 
system approach which leads to generalized synchronization. 


a b 
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40 x3 (t) 
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Figure 19.7 [Python] Synchronization between (19.15) and (19.16): (a) x 2(t) and y 9(0), (b) x 3(t) and y 
3(0. 


Generalized Synchronization 

Abarbanel et al. [1] introduce the auxiliary system approach which utilizes a 
second, identical response system to monitor the synchronized motions. They 
take system (19.14) and split it into three subsystems, one the driver system, one 
the response , and the third an auxiliary system, which is identical to the 
response system. 


x = d(x(f)) driver, 
y = r(y(t),g,x(t)) response, 
Z = a(z(t),g,x(t)) auxiliary, 


where xe RK, y E R”, ze Rl, k+m+l=n, and g represents the coupling 


strength. They state that two systems are generally synchronized if there is a 
transformation, say, T, so that y(t) = T (x(7)). When the response and auxiliary 


are driven by the same signal, then y(t) = T (x(f)) and z(t) = T (x(¢)), and it is 


clear that a solution of the form y(t) = z(t) exists as long as the initial conditions 


lie in the same basin of attraction. They further show that when the manifold y = 
z is linearly stable, then the conditional Lyapunov exponents for the response 
system, driven by x(t), are all negative. 

As a specific example, they consider generalized synchronization of chaotic 
oscillations in a three-dimensional Lorenz system that is driven by a chaotic 
signal from a Roéssler system. The driver Rossler system is 


Xij = —(X> + x3), X2 = xı + 0.2x2, X3 = 0.2 + X3(X] — ji), 


(19.18) 
the response Lorenz system is 


yi = o2- y1) -801-7 x1), Yo=M1-Y2-Yiy3, Y3 = Y1y2 — by3,(19.19) 
and the auxiliary Lorenz system is 
Z% = 02- 7a)- 8i- X) Z% =r- 22-213, Z% = ZZ — bz3.(19.20) 
Consider 

e = y(t) — z(t) = error signal. (19.21) 


The function 
1 2 2 2 


can be used as a Lyapunov function for the coupled system (19.19) and (19.20) 
as long as the coupling parameter g satisfies the inequality 


2 
: + + z% 
< |--o +r- —-o. 
SS\q =e 
The z ,(t), i = 1, 2, 3, are bounded on a chaotic attractor, and so this condition can 


be satisfied when g is large enough. The numerical solutions to the nine- 
dimensional differential equations are easily computed with Python. A program 
is listed in Section 19.5. Figure 19.8(a) shows synchronization between y (t) and 


Z o(t) when g = 8. Figure 19.8(b) shows that y (t) and z (t) are not synchronized 
when g = 4. 


Figure 19.8 [Python] (a) Synchronization between y 2(t) and z 2(t) when the coupling coefficient is g = 8 


between systems (19.18), (19.19), and (19.20). (b) When g = 4, the system is not synchronized. The 
coupling is not strong enough. 


There are examples of chaos control and synchronization in brain dynamics, see 
Chapter 21, and open problems are considered in [29]. 


19.5 Python Programs 


# Program 19a: Chaos control in the logistic map. 
# Control to period two. 
# See Figure 19.3(b). 


import matplotlib.pyplot as plt 
import numpy as np 


# Parameters 

mu = 4 

k = 0.217 

num_iterations = 60 

xs, x = [], [0.6] 

ns = np.arange(0, num_iterations, 2) 

nsc = np.arange(num_iterations, 2*num_iterations, 2) 


for n in ns: 
x1 = mu*x[n] * (1 - x[n]) 
x.append(x1) 
xs.append([n, x1]) 


x2 = mu*x1 * (1 - x1) 
X.append( x2) 
xS.append([n+1, x2]) 


for n in nsc: 
x1 = k*mu*x[n] * (1 - x[n]) 
X.append(x1) 
XS.append([n, x1]) 
x2 = mu*x1 * (1 - x1) 
X.append(x2) 
XS.append([n+1, x2]) 


XS = np.array(xs) 


fig, ax = plt.subplots(figsize=(8, 8)) 
plt.plot(xs[:, 0], xs[:, 1]) 
plt.plot(xs[:, 0], xs[:, 1], ‘ro’) 
plt.xlabel(’n’, fontsize=15) 
plt.ylabel(r’$x_n$’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.show() 


# Program 19b: Chaos control in the Henon Map. 
# See Figure 19.6. 


import matplotlib.pyplot as plt 
import numpy as np 

# Parameters 

a, b= 1.2, 0.4 

xstar = ystar = 0.8358 

ki; k2 = 248) 1:2 
num_iterations = 199 

Es Sub 

x, y=0.5, 0.6 


ns = np.arange(num_iterations) 
nsc = np.arange(num_iterations, 2*num_iterations) 


for n in ns: 
xn = a + b*y - x**2 


yn = X 

xX, y = xn, yn 

r = np.sqrt(x**2 + y**2) 
rs.append([n, r]) 


# Check point is in control region 
print(x, y) 


for n in nsc: 
xn = - 
ki (x - xstar) - k2 (y - ystar) + a+ b*y - x**2 
yn =x 
xX, Y= xn, yn 
r = np.sqrt(x**2 + y**2) 
rs.append([n, r]) 


rs = np.array(rs) 


fig, ax = plt.subplots(figsize=(8, 8) ) 
plt.plot(rs[:, 0], rs[:, 1]) 
plt.plot(rs[:, 0], rs[:, 1], ‘ro’) 
plt.xlabel(’n’, fontsize=15) 
plt.ylabel(r’$r_n42$’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.show() 


# Program 19c: Synchronization between two Lorenz s 
ystems. 
# See Figure 19.7(b). 


import numpy as np 
import matplotlib.pyplot as plt 
from scipy.integrate import odeint 


# Constants 
Sigma = 16 


r = 45.92 
tmax = 100 


t = np.arange(0.0, tmax, 0.1) 


def two_lorenz_odes(X, t): 
x1, x2, x3, y2, y3 = X 


dx1 = sigma * (x2 - x1) 
dx2 = -x1 * x3 + r*x1 - x2 
dx3 = x1 x2 - bx3 

dy2 = -x1 y3 + rxi - y2 
dy3 = x1 y2 - by3 


return (dx1, dx2, dx3, dy2, dy3) 


= [15, 20, 30, 10, 20] 
X = odeint(two_lorenz_odes, y0, t, rtol=1e-6) 
x1, x2, x3, y2, y3 = X.T # unpack columns 
plt.figure(1) 


plt.plot(x3, y3) 
plt.xlabel(r’$x_3$’, fontsize=15) 
plt.ylabel(r’$y_3$’, fontsize=15) 
plt.show() 


# Program 19d: Generalized synchronization. 
# See Figure 19.8(a). 


import numpy as np 
import matplotlib.pyplot as plt 
from scipy.integrate import odeint 


# Constants 


mu = 5.7 

Sigma = 16 

b= 4 

r = 45.92 

g = 8 # When g=4, there is no synchronization. 


tmax = 100 
t = np.arange(0.0, tmax, 0.1) 


def rossler_lorenz_odes(X,t): 
x1, x2, x3, y1, y2, y3, z1, z2, 73: =X 


dx1 = -(x2 + x3) 

dx2 = x1 + 0.2*x2 

dx3 = 0.2 + x3 * (x1 - mu) 

dy1 = sigma * (y2 - y1) - g * (y1 - x1) 
dy2 = -y1 y3 + ry1 - y2 

dy3 = y1 y2 - by3 

dz1 = sigma (z2 - z1) - g (z1 - x1) 
dz2 = -z1*z3 + r*z1 - z2 

dz3 = z1*z2 - b*z3 


return (dx1, dx2, dx3, dy1, dy2, dy3, dz1, dz2, 
dz3) 


yO = [2, -10, 44, 30, 10, 20, 31, 11, 22] 

X = odeint(rossler_lorenz_odes, y0, t, rtol=1e-6) 

x1, x2, x3, y1, y2, y3, x1, z2, Z3 = X.T # unpack 
columns 


plt.figure(1) 

# Delete first 500 iterates. 
plt.plot(y2[500:len(y2)], z2[500:len(z2)]) 
plt.xlabel(r’$y_2$’, fontsize=15) 
plt.ylabel(r’$z_2$’, fontsize=15) 
plt.show() 


19.6 Exercises 


1. 
Show that the map defined by 


> 
tag = l + Yn- AXn, Yml = DXn 


can be written as 
_ bv, — 2 > = 
Un+1 = A+ DVn Un» Vn+1 = Un 


using a suitable transformation. 
2. Apply the method of chaos control by periodic proportional pulses (see 
Section 19.2) to the logistic map 


Xn+1 = MX, C1 = Xn) 


when 4 = 3. 9. Sketch the graphs C ‘(x), i= 1 to 4. Plot time series data to 
illustrate control of fixed points of periods one, two, three, and four. 


Find the points of periods one and two for the Hénon map given by 
2 
Xn+1 54+ by, — Xn  Yn+1 = Xn 


when a = 1. 4 and b = 0. 4, and determine their type. 
. Apply the method of chaos control by periodic proportional pulses (see 
Section 19.2) to the two-dimensional Hénon map 


2 
Xn+1 = at by, — Xw  Yn+1 = Xn» 


where a = 1. 4 and b = 0. 4. (In this case, you must multiply x ,, by k , and y 
m DY K 9, say, once every p iterations). Plot time series data to illustrate the 
control of points of periods one, two, and three. 


Use the OGY algorithm given in Section 19.3 to 
stabilize a point of period one in the Hénon map 


7 
Xn+1 = A+ by, T Xn Ynt+l = Xn 


when a = 1. 4 and b = 0. 4. Display the control using a 
time series graph. 
Consider the Ikeda map , introduced in Chapter 16, when A = 2. 7 and B 
given by = 0. 15. How many 
oo oe points are there of 
Em1 =A + BE,e'™". period one? Indicate 
where these points 
Suppose that E „ =X n + iy „ rewrite the Ikeda map as are with respect to 
a two-dimensional map in x „ and y „. Plot the chaotic the attractor. 


attractor for the Ikeda map 


ae) 
Env =At BE, 


Plot the chaotic attractor for the Ikeda map 
En+1 = A+ BE, el!" 


when 
(i) 

A=4and B= 0. 15; 
(ii) 

A=7 and B=0. 15. 

How many points are there of period one in each 
case? Indicate where these points are for each of the 
attractors on the figures. 


Use the OGY method (see Section 19.3 the parameter 
A to control the chaos to a point of period one in the 
Ikeda map 


“sa 12 
Epi =A+t BEE" 


when A 9 = 2. 7 and B = 0. 15. Display the control on a 
time series plot. (N.B.: Use a two-dimensional map). 


Try the same procedure of control to period one for 
the Ikeda map as in Exercise 8 but with the parameters 
A, =7 and B= 0. 15. Investigate the size of the 


control region around one of the fixed points in this 
case and state how it compares to the control region in 
Exercise 8. What can you say about flexibility and 
controllability? 


10. 
Use the methods described in Section 19.4 to 


demonstrate synchronization of chaos in Chua’s 
circuit . 
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20. Neural Networks 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


To provide a brief historical background to neural networks. 

To investigate simple neural network architectures. 

To consider applications in the real world. 

To present working Python program files for some neural networks. 
To introduce neurodynamics. 


On completion of this chapter, the reader should be able to 


e use the generalized delta learning rule with backpropagation of errors to train 
a network; 

e determine the stability of Hopfield networks using a suitable Lyapunov 
function; 

e use the Hopfield network as an associative memory; 

e study the dynamics of a neuromodule in terms of bistability, chaos, 
periodicity, quasiperiodicity, and chaos control. 


Neural networks are being used to solve all kinds of problems from a wide 
range of disciplines. Some neural networks work better than others on specific 
problems and the models are run using continuous, discrete, and stochastic 
methods. For more information on stochastic methods , the reader is directed to 
the textbooks at the end of this chapter. The topic is highly interdisciplinary in 
nature, and so it is extremely difficult to develop an introductory and 
comprehensive treatise on the subject in one short chapter of a textbook. A brief 
historical introduction is given in Section 20.1 and the fundamentals are 
reviewed. Real-world applications are then discussed. The author has decided to 
concentrate on three types of neural network—the feedforward multilayer 


network and backpropagation of errors using the generalized delta learning rule, 
the recurrent Hopfield neural network, and the minimal chaotic neuromodule. 
The first network is probably the most widely used in applications in the real 
world; the second is a much studied network in terms of stability and Lyapunov 
functions; and the third provides a useful introduction to neurodynamics. 

For a more detailed historical introduction and review of the theory of neural 
networks, the reader is once more directed to the textbooks in the reference 
section of this chapter, see [2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 
22], and [24, 25, 26, 27, 28, 29, 30], for example. For Python programming in 
neural networks, see [28]. 

Some of the Python programs listed in Section 20.5 are quite long. 
Remember that you can download the Python files from the Web. Those readers 
already familiar with neural networks should read the Python Help pages for 
more advanced features. 


20.1 Introduction 


This textbook has thus far been concerned with deterministic dynamical systems 
where the underlying equations are known. This chapter provides a means of 
tackling nondeterministic systems , where the equations used to model the 
system are not known. Unfortunately, many real-world problems do not come 
prepackaged with mathematical equations, and often the equations derived might 
not be accurate or suitable. Throughout history, scientists have attempted to 
model physical systems using mathematical equations. This has been quite 
successful in some scientific fields, but not in all. For example, what equations 
would a doctor use to diagnose an illness and then prescribe a treatment? How 
does a bank manager determine whether to issue a mortgage? How can we tell 
whether somebody is telling the truth? These questions have been successfully 
dealt with by the adoption of neural networks, or artificial neural networks , as 
they are sometimes referred to, using machine learning or data mining . 
Applications of this theory will be dealt with in more detail at the end of this 
section. 


Definition 1. A neural network is a parallel information-processing system 
that has certain characteristics in common with certain brain functions . It is 
composed of neurons and synaptic weights and performs complex computations 
through a learning process . 


The brain is a highly complex nonlinear information-processing system. It is a 


parallel computer, infinitely more powerful than traditional, electronic, 
sequential, logic-based digital computers, and powerful parallel and vector 
computers on the market today. The average human brain consists of some 10!" 
neurons, each about 100 pm in size, and approximately 1014 synapses. The 
synapses, or dendrites , are mainly chemical, converting electrical signals into 
chemical signals and back to electrical again. The synapses connecting neurons 
store acquired knowledge and can be excitatory or inhibitory . It should be 
pointed out that the numbers of neurons and synaptic weights do not remain 
constant in the human brain. Scientists are attempting to incorporate some 
features of the way the brain works into modern computing. 

Network Architecture 

The neuronal model is made up of four basic components: an input vector , a 
set of synaptic weights, a summing junction with an activation , or (transfer) , 
function, and an output . The bias increases or decreases the net input of the 
activation function. Synapses receive input signals that they send to the neural 
cell body; the soma (summing junction) sums these signals; and the axon 
transmits the signal to synapses of connecting neurons. A schematic illustrating a 
simple mathematical model of a neuron is shown in Figure 20.1. 


X] 
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Figure 20.1 A simple nonlinear model of a single neuron k. The vector y — ( x,)/ represents 


Kja N ases 


the input; the synaptic weights are denoted by w k = w kj» j=1,2,...,n; b is the bias; (. ) is the activation 


function applied after a summation of the products of weights with inputs; and y x is the output of neuron k. 


The neuron has bias b ;, which is added to the summation of the products of 
weights with inputs to give 


Vk = WX + by, 
where v ; is the activation potential . The neuron output is written as 


Yk = $ Vi). 
Note in this case that w ; is a vector. The activation function @(. ) typically 
ranges from — 1 to + 1 (is bipolar ) in applications, and has an antisymmetric 
form with respect to the origin. This textbook will be concerned mainly with 
bipolar activation functions. There are unipolar activation functions, where the 
function ranges from 0 to + 1, but bipolar functions are predominantly used in 
applications. Some bipolar activation functions are shown in Figure 20.2. They 
are defined by the following equations: 


l, v20 
(a) g0) = ee 
1, v>0.5 
(b) øo) =4 v, —0.5<v<0.5 
-1, v < —0.5; 


(c) d(v) = tanh(av); 


cosh(a(v + 1)) 
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Figure 20.2 Some activation functions: (a) a Heaviside function ; (b) a piecewise linear function ; (c) a 
sigmoid function ; (d) a low-gain saturation function . 
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Figure 20.3 A feedforward single layer network. 


The all-or-none law model of a neuron devised by McCulloch and Pitts [17] 
in the early 1940s is widely acknowledged as the origin of the modern theory of 
neural networks. They showed, in principle, that the neuron could compute any 
arithmetic or logical function. Indeed, even today, the McCulloch-Pitts neuron is 
the one most widely used as a logic circuit. In 1949 Hebb [10] proposed the first 
learning law for neural networks used to modify synaptic weights. He suggested 
that the strength of the synapse connecting two simultaneously active neurons 
should be increased. There are many variations of Hebb’s learning law, and they 
are being applied to a variety of neural network architectures; see Section 20.3, 
for example. In 1958 Rosenblatt [22] introduced a class of neural network called 
the perceptron . A typical architecture is shown in Figure 20.3. It was found that 
the perceptron learning rule was more powerful than the Hebb rule. 
Unfortunately, shortly afterwards it was shown that the basic perceptron could 
only solve problems that were linearly separable. One simple example of a 
problem that is not linearly separable is the exclusive or (XOR) gate . An XOR 
gate is a circuit in a computer that fires only if one of its inputs fire. 

Training 

In 1960 Widrow and Hoff [30] introduced the ADALINE (ADAptive LInear 
NEuron) network, and a learning rule labeled as the delta learning rule or the 
least mean squared (LMS) algorithm. The perceptron learning rule adjusts 
synaptic weights whenever the response is incorrect, whereas the delta learning 
rule adjusts synaptic weights to reduce the error between the output vector and 


the target vector. This led to an improved ability of the network to generalize. 
Neither the ADALINE nor the perceptron were able to solve problems that were 
not linearly separable, as reported in the widely publicized book of Minsky and 
Papert [18]. Rumelhart and McClelland [24] edited a book that brought together 
the work of several researchers on backpropagation of errors using multilayer 
feedforward networks with hidden layers (see Figure 20.4). This algorithm 
partially addressed the problems raised by Minsky and Papert in the 1960s. 
Nowadays, over 90% of the applications to real-world problems use the 
backpropagation algorithm with supervised learning . Supervised learning is 
achieved by presenting a sequence of training vectors to the network, each with a 
corresponding known target vector . A complete set of input vectors with known 
targets is known as an epoch ; it is usually loaded as a data file. A 
backpropagation algorithm using a supervised generalized delta learning rule is 
discussed in more detail in Section 20.2. Throughout the 1980s, Kohonen [15] 
developed self-organizing feature maps to form clusters for unsupervised 
learning . No target vectors are required for this algorithm—similar input 
vectors are assigned the same output cluster . 
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Figure 20.4 A feedforward neural network with one hidden layer ; there are three neurons in the hidden 
layer and two in the output layer. 


The seminal paper of Hopfield [13] published in 1982 used statistical 
mechanics to explain the operation of a recurrent neural network used as an 
associative memory . The architecture of a recurrent Hopfield neural network 
comprising three neurons is shown in Figure 20.5. The main difference between 
a feedforward network and a recurrent network is that there is feedback in the 
latter case. Figure 20.5 illustrates the multiple-loop feedback for a three-neuron 
module. Note that the output of each neuron is fed back to each of the other 
neurons in the network. 


bias 


Figure 20.5 A recurrent Hopfield neural network with feedback. Note that there is no self-feedback in this 
case. 


The network operation can be analyzed using Lyapunov functions (see 
Chapter 6). Both continuous and discrete recurrent Hopfield networks are 
discussed in more detail in Section 20.3. 

Applications. The field of neural networks has generated a phenomenal 
amount of interest from a broad range of scientific disciplines. One of the 
reasons for this is adaptability. Innovative architectures and new training rules 
have been tested on powerful computers, and it is difficult to predict where this 
research will take us in the future. As mentioned earlier, the vast majority of 
real-world applications have relied on the backpropagation algorithm for training 
multilayer networks, and recently kernel machines have proved to be useful for a 
wide range of applications, including document classification and gene analysis, 
for example. In general, more than one network is required and each network is 
designed to perform a specific task. Some well-known applications are listed and 
a more in-depth account is given for the research carried out on psychological 
profiling in the Department of Computing and Mathematics at Manchester 
Metropolitan University. The list is by no means exhaustive and it will not be 
difficult for the reader to find examples applied in their own research area. 

Neural networks are being used extensively in the fields of aeronautics, 
banking, defense, engineering, finance, insurance, marketing, manufacturing, 
medicine, robotics, psychology, security, and telecommunications. One of the 


early applications was in signal processing; the ADALINE was used to suppress 
noise on a telephone line. Many neural networks are being used as associative 
memories for pattern and speech production and recognition, for example. 
Simple networks can be set up as instant physicians . The expertise of many 
general practitioners can be used to train a network using symptoms to diagnose 
an illness and even suggest a possible treatment. In engineering, neural networks 
are being used extensively as controllers , and in banking they are being used in 
mortgage assessment . Scientists find them very useful as function 
approximators . They can test whether the mathematical equations (which could 
have been used for many years) used to model a system are correct. 

The Artificial Intelligence Group at Manchester Metropolitan University has 
developed a machine for automatic psychological profiling . The work has 
generated a huge amount of interest and recently was reported on national 
television in many countries around the world. Bandar et al. [1] have patented 
the machine, and the expectations are high for future applications. The machine 
could be used in police questioning, at airport customs, and by doctors 
diagnosing schizophrenia, depression, and stress. A short article on using the 
machine as a lie detector has recently appeared in New Scientist [23]. The group 
claims that the lie detector is accurate in 80% of test cases. Their machine uses 
about 20 independent neural networks; each one using the generalized delta 
learning rule and backpropagation of errors. Some of the channels used in the 
machine include eye gaze, blinking, head movement forward, hand movement, 
and blushing. 

The same group has also carried out extensive work on conversational agents 
. It will not be long before we are all able to have conversations with our 
computers. 

This introductory section has given a brief overview of neural networks. For 
more detailed information the reader is directed to the many Neural Networks 
textbooks listed in the reference section of this chapter. 


20.2 The Delta Learning Rule and Backpropagation 


Widrow and Hoff [30] generalized the perceptron training algorithm to 
continuous inputs and outputs and presented the delta rule (or LMS rule). 
Consider a single neuron as in Figure 20.1. If the activation function is linear, 
then 


Yk = ` WkjXj + by. 


J 
Define an error function by the mean — error, SO 


B= ay ED 5) ay È eee 


where the index x ranges over all input vectors, N is the number of neurons, E * 
is the error on vector x, and t ; is the target (or desired ) output when vector x is 


presented. The aim is to minimize the error function E with respect to the 
weights w yj. It is an unconstrained optimization problem ; parameters w yj are 


sought to minimize the error. The famous method of steepest descent is applied 
to the error function. Theorem 1 gives the delta rule when the activation function 
is linear. There are two ways to update the synaptic weights using the 
generalized delta rule. One is instantaneously (a weight is updated on each 
iteration) and the other is batch (where the weights are updated based on the 
average error for one epoch). 


Theorem 1. 
The iterative method of steepest descent for adjusting the weights in a neural 
network with a linear activation function is given by 


Wen + 1) = Wen) — 18 Kj. 
where n is the number of iterates, g}; = — (tk — yx) x; is the gradient vector , 


and n is a small positive constant called the learning rate . 


Proof. 
Partially differentiating the error with respect to the weight vector gives 
OE(wxj) OE OE% dy, 
OW; ~ OEX Oye Ow, Owe; 


Now 


OE 


—— =F, =(k-Ye)s 
OES 


and 


OE* 
Oy, 
and 


Oy k 


OW xj 
An estimate for the gradient vector is 
Bkj = Yk- tk) Xj. 
The delta rule for a linear activation function is thus formulated as 
wy + 1) = we) — 18K): 


where 77 is the learning rate parameter. The choice of ņ is important in 
applications. If it is too large the algorithm can become unstable. One normally 
experiments with n; it is not desirable for the algorithm to converge too slowly. 


Note that there are other optimization methods available, such as Newton’s 
method and the Gauss-Newton method , which converge quicker and are less 
sensitive to the choice of n. 


Theorem 2. When the activation function is nonlinear, say, yx = ¢ (vx) , the 


generalized delta rule can be formulated as 


wn + 1) = wen) — 18K); (20.1) 
where 
Od 
kj = (Ve - tk) Ay ti (20.2) 
Vk 


Proof. The proof will be left as an exercise for the reader in Section 20.6. 


The Backpropagation Algorithm 

If neuron k is an output neuron, then Theorem 2 can be applied to adjust the 
weights of the synapses. However, if neuron j is a hidden neuron in a layer 
below neuron k, as depicted in Figure 20.6, then a new algorithm is required. 


Theorem 3. 


When neuron j is in a hidden layer, the error backpropagation rule is formulated 
as 


w y(n + 1) = win) — iEn (20.3) 
where 
Od Od 
i= k — Uk) >—Wkj | Zui 
Sj } [ox k) am ane (20.4) 


Proof. The proof is left as an exercise for the reader. The error is 
backpropagated through the network, layer by layer—back to the input layer, 
using gradient descent. 


i kj 
Figure 20.6 An output neuron k connected to a hidden neuron j. 


The generalized delta rule and backpropagation will now be applied to 
examples for estimating the value of owner-occupied homes in Boston, 
Massachusetts, in the 1970s. 

The Boston housing data was downloaded from the UCI Machine Learning 
Repository on the Web at http://www.ics.uci.edu/~mlearn/MLRepository.html. 

The data can be found in the file housing.txt that can be downloaded with the 
Python files. Other databases at the site include arrhythmia data, automobile 
miles per gallon data, breast cancer data, and credit screening data. 

The Boston housing data was created by D. Harrison and D.L. Rubinfeld, 
(Hedonic prices and the demand for clean air, J. Environmental Economics and 
Management, 5 (1978), 81—102). They reported on housing values in the suburbs 
of Boston. There are 506 input vectors and 14 attributes including per capita 
crime rate by town, average number of rooms per dwelling, and pupil-teacher 
ratio by town. 


Example 1. Write a Python program to apply the generalized delta learning 
rule to the Boston housing data for three attributes : columns six (average 
number of rooms), nine (index of accessibility to radial highways), and 13 
(percentage lower status of population), using the target data presented in 


column 14 (median value of owner-occupied homes in thousands of dollars). 
Use the activation function (v) = tanh(v) and show how the weights are 
adjusted as the number of iterations increases. This is a simple three-neuron 
feedforward network; there are no hidden layers and there is only one output 
(see Figure 20.1). 


Solution. The Python program file is listed in Section 20.5. A summary of the 
algorithm is listed below to aid in understanding the program: 


1. 
Scale the data to zero mean, unit variance, and introduce a bias on the 


input. 
Set small random weights. 
Set the learning rate, say, n, and the number of epochs. 


Calculate model outputs y ;, the error t , — y ;, the gradients g, and 
perform the gradient descent to evaluate w ,,(n + 1) = w (n) -ng w for 
each weight, see Equation (20.3). 


Plot a graph of weight values versus number of iterations. 


Note that '(v) = 1 - ((v))?, since (v) = tanh(v). The reader will be asked 
to verify this in the exercises. The synaptic weights converge to the following 
approximate values: b į * —0. 27, w 1, * 0. 2, w 12 * —0. 04, and w 43 S —0. 24, as 


shown in Figure 20.7. 


Example 2. Use the generalized delta rule with batch backpropagation of 
errors on the full data set listed in housing.txt for the Boston house data. Use the 
same activation function as in Example 1 and introduce one hidden layer in the 
neural network. Compare performance for one and two neurons in the hidden 
layer, when ņ = 0. 05. One epoch consists of 506 input vectors, each with one 
target, and there are 13 input vectors. 
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Figure 20.7 [Python] Updates of the four weights (including the bias) against the number of iterations. 


Solution. A summary of the algorithm is listed below to aid in producing the 
program (which is left as an exercise for the reader): 


1. 
Scale the data to zero mean, unit variance, and introduce a 


bias on the input. 


2. 
Iterate over the number of neurons in the hidden layer. 
3. 
Set random weights for the hidden and output layers. 
4. 
Iterate over a number of epochs using batch error 
backpropagation. 
a 


Compute model outputs and the error. 


b. 
Compute output and hidden gradients and perform gradient 


descent. 


Determine the mean squared error for each epoch. 


Plot a graph of mean squared error versus the number of 
epochs for each number of neurons in the hidden layer. 


Note that it is possible to work with any number of hidden layers, but in 
general one hidden layer suffices. Indeed, it has been shown that one hidden 
layer is sufficient to approximate any continuous function. Often the 
functionality that comes from extra hidden layers causes the network to overfit. 
The results on the full data set are shown in Figure 20.8. 
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Figure 20.8 Number of epochs versus mean squared error for the Boston housing data. The upper curve is 
the error with one hidden neuron (settles to approximately 0.2); the lower curve is the error with two hidden 
neurons (stabilizes to approximately 0.14). The learning rate used in this case was ņ = 0. 05. 


20.3 The Hopfield Network and Lyapunov Stability 


This section is concerned with recurrent neural networks that have fixed synaptic 
weights but where the activation values undergo relaxation processes through 
feedback. A primary application of the Hopfield network is as an associative 
memory , where the network is used to store patterns for future retrieval. The 
synaptic weights are set such that the stable points of the system correspond with 


the input patterns to be stored. One can think of these states as local minima in 
energy space. When a noisy or incomplete test pattern is input, the system 
should settle onto a stable state that corresponds to a stored pattern. A discrete 
Hopfield network is discussed in some detail later in this section, where it is 
used as an associative memory on some patterns. It should be noted that another 
famous problem addressed by Hopfield and Tank [11] was in optimization and is 
known as the traveling salesman problem . Simple continuous Hopfield 
networks are considered before the applications in order to highlight stability 
properties using Lyapunov functions. 

The Continuous Hopfield Model 

A Hopfield network does not require training data with targets. A network 
consisting of three neurons is shown in Figure 20.5, and a two-neuron module is 
shown in Figure 20.6. In 1984, Hopfield [12] showed how an analog electrical 
circuit could behave as a small network of neurons with graded response. He 
derived a Lyapunov function for the network to check for stability and used it as 
a content-addressable memory . The differential equations derived by Hopfield 
for the electrical circuit using Kirchhoff’s laws could be reduced to the following 
system of differential equations 


La = —x(t) + Wa(t) + b, 
dt 


(20.5) 
where x(t) is a vector of neuron activation levels , W is the weight matrix 
representing synaptic connections, b are the biases, and a(t) = @(x(f)) are the 


nonlinear input/output activation levels. Hopfield derived the following theorem 
for stability properties. 
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Figure 20.9 A simple recurrent Hopfield neural network, a two-neuron module. 


Theorem 4. 
A Lyapunov function for the n-neuron Hopfield network defined by equation ( 
20.5 ) is given by 


Í a n aj 7 

V(a) = —-a’ Wa + > f ob '(u)du -b'a (20.6) 
2 i=] \V0 
as long as 
l ‘(a ;) is an increasing function, that is, 

d 
— g! (ai) >0, and 
da; 


2. 
the weight matrix W is symmetric. 


Proof. The proof is left as an exercise for the reader (see Section 20.6). 


Consider the following two-neuron module taken from Hopfield’s original paper 


[13]. 


Example 3. 
A schematic of the two-neuron module is shown in Figure 20.9. The differential 
equations used in Hopfield’s model are given by 


a , a 


= + Stan ( 
2 E 2 


2 A 
x = —x + — tan 
T 


where the activation functions are arctan. Determine the stable critical points 


and derive a Lyapunov function. 


Solution. In this case 


fd _ {0 2.) (ymx ey 2 
w= (7 5). b=(5)- a= stan (F) a2 = =tan (=). 


A Lyapunov function, derived using equation (20.6), is given by 


1 a 
V(a) = 5 (41 al ; \ a | + Í ob '(u)du+ 


f p` (udu — (0 0) | 7 ) 
0 a2 


V(a) = -aia — = (log (cos(sta;/2)) + log (cos(maz/2))). 


Therefore, 


Vector field plots for the differential equations are shown in Figure 20.10. The 
corresponding Lyapunov functions can be plotted using Python when y is given 
(see Section 6.2). Plot the surface for|a;|<1,i=1, 2. 
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Figure 20.10 Vector field plots when (a) 0 < y < 1, (b) y > 1, and (c) y > œ. 


When 0 < y < 1, there is one stable critical point at the origin (see 

Figure 20.10(a)). As y passes through one, two stable critical points bifurcate 
from the origin and the critical point at the origin becomes unstable (see 
Figure 20.10(b)). As y > œ, the stable critical points approach corners of the 
unit square as depicted in Figure 20.10(c). 


Example 4. 
Consider the recurrent Hopfield network modeled using the differential 
equations 


2 X 2 ) 
x= —x+2[—tan! (=) , y=-yt2 = tan! (=) . 
T 2 T 2 


Plot a vector field portrait and derive a suitable Lyapunov function. 


20 0 
W = d b= . 
(02) e v=o] 
A vector field plot is shown in Figure 20.11. There are four stable critical points 
and five unstable critical points. 


Solution. In this case, 


Figure 20.11 A vector field plot for Example 4 when y = 0. 7. There are nine critical points. 


A Lyapunov function is given by 


4 


V(a) = —(a7 + a5) - — 
ya 


(log (cos(sa,/2)) + log (cos(maz/2))). 


You can plot the Lyapunov function using Python. 

Continuous Hopfield networks with self-feedback loops can be Lyapunov 
stable. However, discrete systems must have no self-feedback to guarantee 
Lyapunov stability. 

The Discrete Hopfield Model 

Hopfield [11, 12, 13] used his network as a content-addressable memory 
using fixed points as attractors for certain fundamental memories . The Hopfield 
model can be summarized using the following four-step algorithm. There is no 
self-feedback in this case. 


1 


` Hebb’s Postulate of Learning . Let x 4, X 5,..., X y denote a set of N- 


dimensional fundamental memories. The synaptic weights of the network are 
determined using the formula 


M 
l , M 
W= N 2 XX. — Wie 


where I „is the N x N identity matrix. Once computed, the synaptic weights 
remain fixed. 


2: Initialization. Let x „ denote the unknown probe vector to be tested. 
The algorithm is initialized by setting 


X(O) = Xin, LS delca, 


where x ;(0) is the state of neuron i at time n = 0, x ;p is the ith element 


of vector x pi and N is the number of neurons. 


Iteration. The elements are updated asynchronously (i.e., one at a time in a 
random order) according to the rule 


N 
xi(n + 1) = hsgn » wijx;(n) j,i = 1,2,...,N, 
j=l 
where 
l, v(n+1)>0 
hsen(vi(n+1)) =< x(n), v(n+1)=0 
-l, v(n+1)<0 


and v ;(n+1)=}j=1 Nw ij X j(1). The iterations are repeated until the 
vector converges to a stable value. Note that at least N iterations are carried 
out to guarantee convergence. 


Result. The stable vector, say, X fixeg» is the result. 


The algorithm above uses asynchronous updating of synaptic weights. 
Synchronous updating is the procedure by which weights are updated 
simultaneously. The fundamental memories should first be presented to the 
Hopfield network. This tests the network’s ability to recover the stored vectors 
using the computed synaptic weight matrix. The desired patterns should be 
recovered after one iteration; if not, then an error has been made. Distorted 
patterns or patterns missing information can then be tested using the above 
algorithm. There are two possible outcomes. 


1. 
The network converges to one of the fundamental memories. 


2. The network converges to a spurious steady state . Spurious steady states 
include the following: 


a. 
Reversed fundamental memories —e.g., if x s is a fundamental 
memory then so is -X . 

b. 
Mixed fundamental memories —a linear combination of 
fundamental memories. 

c. 


Spin-glass states —local minima not correlated with any 
fundamental memories. 


Before looking at an application of a Hopfield network as a content- 
addressable memory, a simple example is shown below to illustrate the 
algorithm. 


Example 5. 
A five-neuron discrete Hopfield network is required to store the following 
fundamental memories: 


“Edy. SS Lee SSL SIAL 


a 


(a) Compute the synaptic weight matrix W. 

(b) Use asynchronous updating to show that the three fundamental memories 
are stable. 

(c) Test the following vectors on the Hopfield network (the random orders 
affect the outcome): 


eS (ale i eee 1 ee Sk keD, 


Solution. (a) The synaptic weight matrix is given by 


l 3 
W = 5 (xx? + XX} + X3X4 | = zis 


SO 


1 -] O 1 1 3 
W=-| 1 1 0 -1 1 
S 1 1 -1 O 1 

-] 3 1 1 O 


(b) Step 1. First input vector, x 4 = x(0) = (1, 1, 1, 1, 1)". 
Step 2. Initialize x ,(0) = 1, x (0) = 1, x ,(0) = 1, x 4(0) = 1, x (0) = 1. 
Step 3. Update in random order x 3(1), x 4(1), x ,(1), X 5(1), x 2(1), one at 
a time. 


x3(1) = hsgn(0.4) = 1, 
x41) = hsgn(0.4) = 1, 
xı(1) = hsgn(0) = x,(0) = 1, 


xs(1) = hsgn(0.8)= 1; 
x2(1) = hsgn(0.8) = 1. 


Thus x(1) = x(0) and the net has converged. 
Step 4. The net has converged to the steady state x 4. 
Step 1. Second input vector, x 5 = x(0) = (1, -1,-1, 1, -1)". 
Step 2. Initialize x ,(0) = 1, x ,(0) = -1, x 3(0) = -1, x ,(0) = 1, x ,(0) = -1. 
Step 3. Update in random order x ;(1), x 3(1), x 4(1), x 1(1), x 2(1), one at 
a time. 


xs(1) = hsgn(—0.8) = —1, 
x3(1) = hsgn(—0.4) = —1, 
x4(1) = hsgn(O) = x4(Q) = 1, 


x11) = hsgn(0.4) = 1, 
x2(1) = hsgn(—0.8) = —1. 


Thus x(1) = x(0) and the net has converged. 
Step 4. The net has converged to the steady state x 5. 
Step 1. Third input vector, x > = x(0) = (-1, 1, -1, 1, 1). 
Step 2. Initialize x ,(0) = -1, x 2(0) = 1, x ,(0) = -1, x ,(0) = 1,x ,(0) = 1. 
Step 3. Update in random order x 5(1), x ;(1), x 4(1), x 2(1), x 3(1), one at 
a time. 


x5(1) = hsgn(0.8) = 1, 

x11) = hsgn(—0.4) = -1, 
x4(1) = hsgn(0.4) = 1, 

x2(1) = hsgn(0.8) = 1, 

x3(1) = hsgn(O) = x3(0) = -1. 


Thus x(1) = x(0) and the net has converged. 
Step 4. The net has converged to the steady state x 3. 
(c) Step 1. Fourth input vector, x 4 = x(0) = (1, -1, 1, 1, 1)". 
Step 2. Initialize x ,(0) = 1, x »(0) = -1, x ,(0) = 1, x ,(0) = 1,x <(0) = 1. 
Step 3. Update in random order x 2(1), x 4(1), x 3(1), x 5(1), x ,(1), one at 
a time. 


x2(1) = hsgn(0.8) = 1, 
x41) = hsgn(0.4) = 1, 
x3(1) = hsgn(0.4) = 1, 
x5(1) = hsgn(0.8) = 1, 
xı(1) = hsgn(Q) = x,(O) = 1. 


Thus x(1) = x , and the net has converged. 
Step 4. The net has converged to the steady state x 4. 


Step 1. Fifth input vector, x s = x(0) = (0, 1, -1, 1, 1)f, information is missing 


in the first row. 
Step 2. Initialize x ,(0) = 0, x (0) = 1, x ,(0) = -1, x ,(0) = 1, x (0) = 1. 
Step 3. Update in random order x ,(1), x 5(1), x (1), x 2(1), x 3(1), one at a 
time. 


x41) = hsgn(0.6) = 1, 

x5(1) = hsgn(0.6) = 1, 

x11) = hsgn(—0.4) = -1, 
x2(1) = hsgn(0.8) = 1, 

x3(1) = hsgn(O) = x3(0) = -1. 


Thus x(1) = x 3 and the net has converged. 
Step 4. The net has converged to the steady state x 3. 
Step 1. Sixth input vector, x ș = x(0) = (-1, 1, 1, 1,-1)7. 
Step 2. Initialize x ,(0) = -1, x 2(0) = 1, x ,(0) = 1, x ,(0) = 1, x ,(0) = -1. 
Step 3. Update in random order x 3(1), x (1), x <(1), x 4(1), x (1), one at a 
time. 


x3(1) = hsgn(—0.4) = -1, 
x2(1) = hsgn(—0.4) = -1, 
x5(1) = hsgn(—0.4) = -1, 
x4(1) = hsgn(—0.4) = -1, 


xı(l1) = hsgn(O) = x,(0) = -1. 


Step 3 (again). Update in random order x 5(1), x ,(1), x 5(1), x 4(1), x 3(1), one 
at a time. 


x2(2) = hsgn(—0.8) = —1, 
x1(2) = hsgn(Q) = xı(1) = -1, 
x5(2) = hsgn(—0.8) = —1, 
x4(2) = hsgn(—0.4) = -1, 
x3(2) = hsgn(—0.4) = -1. 


Thus x(2) = x(1) and the net has converged. 
Step 4. The net has converged to the spurious steady state -x 4. 


A Python program implementing the above algorithm can be found in 


Section 20.5. 


Example 6. Write a Python program that illustrates the behavior of the discrete 
Hopfield network as a content-addressable memory using N = 81 neurons and 
the set of handcrafted patterns displayed in Figure 20.12. 


Solution. See Programs 20b listed in Section 20.5 as a guide. Set a noise level to 
i. On average the network will converge after i x 8] = 27 iterations. In order 


for this algorithm to work, the vectors defining the patterns have to be as 
orthogonal as possible. If some patterns are similar, the network will not perform 
very well. 


20.4 Neurodynamics 


It is now understood that chaos, oscillations, synchronization effects, wave 
patterns, and feedback are present in higher-level brain functions and on 
different levels of signal processing. In recent years, the disciplines of 
neuroscience and nonlinear dynamics have increasingly coalesced, leading to a 
new branch of science called neurodynamics. This section will concentrate on a 
minimal chaotic neouromodule , studied in some detail by Pasemann and his 
group [19] and [20]. They have considered chaos control and synchronization 
effects for this simple model. 


Figure 20.12 The patterns to be used as fundamental memories for the discrete Hopfield model. 


A Minimal Chaotic Neuromodule 
The discrete two-dimensional system investigated by Pasemann is defined by 
the map 


Xn+t = by + Whi (Xn) + Wi2h20n), Yny = ba + W2161(%) + W22b2(n), 


(20.7) 
where its activity at time n is given by (x „Y n), b 1 b 2 are biases, w ;j are the 
synaptic weights connecting neurons, and Ọ represents the transfer function 


defined by 


1 
M= = T = 
(20.8) 
The simple network architecture of this recurrent module with an excitory 
neuron and an inhibitory neuron with self-connection is shown in Figure 20.9. 
Pasemann and Stollenwerk (see reference in Chapter 3) considered the model 
with the following parameter values 


bi = -2, by = 3, w11 = —20, w21 = —6, w12 = 6, and wn = Q. 


(20.9) 
Figure 20.13 shows the chaotic attractor for system (20.7) using the transfer 
function in equation (20.8) and the parameters listed in (20.9). 
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Figure 20.13 [Python] The chaotic attractor for a minimal chaotic neuromodule. 


The fixed points of periods one and two may be found in the usual way. 
Fixed points of period one satisfy the simultaneous equations x „+1 = X p = x, and 


Y n+1 =Y n 7Y. There is one fixed point of period one at P ,, = (~1. 2804, 1. 


6951), working to four decimal places. The stability of this fixed point is 
determined by considering the eigenvalues of the Jacobian matrix given by 


ancy J 
_ (Wuxi) Wi25b20) 
= a 
W215, 1 (x) 0 


The eigenvalues for the fixed point of period one are given by A , = —3. 1487,A > 
= —0. 2550, and the fixed point is a saddle point. Hence P ,, is unstable. 

The fixed points of period two are found by solving the equations x „+2 =X p =X, 
and y „+2 =Y n = y, which has two solutions at P 5, = (-7. 8262, — 0. 4623), and P 
22 = (0. 3107, 2.9976). These fixed points are also unstable. 


A Bistable Neuromodule 

As with many nonlinear dynamical systems, higher-level brain functions can 
be subject to feedback. The author and Bandar have investigated system (20.7) 
with the following choice of parameters 


b] = 2, bz = 3, w11 = T; W] = 5, W12 = —4, and W? = 0, 


(20.10) 
and using the transfer functions 


ġı(x) = tanh(ax) and ¢(y) = tanh(ay), (20.11) 


with a = 1 and a= 0. 3. Using numerical techniques, there are three fixed points 
of period one at P 44 = (72. 8331, -1. 9655), P 4> = (0. 2371, 4. 1638), and P 43 = 


(5. 0648, 7. 9996). Using the Jacobian matrix, point P 4; has eigenvalues A 4 = 0. 
0481 + 0. 2388i, A 5 = 0. 0481 - 0. 2020i. The fixed point is stable since |À 4 | < 1 
and |à > | < 1. Points P į and P 43 have eigenvalues A , = 6. 3706, A 5 = 0. 2502 
and A , = 0. 0006 + 0. 0055i, A = 0. 0006 — 0. 0055i, respectively. Therefore 
point P 4> is an unstable saddle point, and point P 43 is stable, since both 


eigenvalues have modulus less than one. We conclude that system (20.7) with 
the parameter values given above (20.10) and the transfer functions defined by 
equations (20.11), is multistable . That is, there are two stable fixed points for 
one set of parameter values and the fixed point attained is solely dependent upon 
the initial conditions chosen. 

Now introduce a feedback mechanism . In the first case we vary the parameter a, 
which determines the gradient of the transfer function Ọ (y). The other 


parameters are fixed as above (20.10). The parameter a is increased linearly 
from a = -5 to a= 5, and then decreased back down to a = —5. Figure 20.14 
shows the bifurcation diagrams for the activity of neuron x. Similar bifurcation 
diagrams may be plotted for the neuron y. The upper figure shows the activity 
against the number of iterations. The lower figure shows the activity level of 
neuron x as the parameter a is increased then decreased. As a is increased from — 
5, the steady state is on the lower branch until a ~ 1, where there is a sudden 
jump to the other steady state. As «æ increases further, the steady state remains at 
X n ¥ 5. As q is decreased, the steady state remains at x „ ¥ 5 until a ¥ 0 where it 


jumps to x , % 15. There is a large bistable region for — 5 < a < 1, approximately. 
In the second case, fix the parameters and vary b ,, which is the bias for 
neuron x. The parameter b , is ramped up from b , = -5 to b į = 5, and then 


ramped back down to b , = —5. There is an isolated counterclockwise bistable 
region for - 1 <b, < 3. 5, approximately (Figure 20.15). 

In the final case, fix the parameters and vary w ,,, which is the synaptic 
weight connecting neuron x to itself. The parameter is decreased from w 4; = 7 
down to zero and then increased back up to w ,, = 7. The activity of neuron x is 
on the lower branch until w 4; * 5.5, where it jumps to the upper branch. As w 41 


decreases, the system descends into regions of quasiperiodicity and periodicity. 
As the parameter is increased from zero, the steady state remains on the upper 
branch, and there is a bistable region for 5.5 < w 4; < 7, approximately; see 
Figure 20.16. 

Clearly, the dynamics of this simple two-neuron module are dependent upon 
the history of the system. The author and his coworkers at Manchester 
Metropolitan University are currently investigating areas of application for this 
research. 
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Figure 20.14 Bifurcation diagrams for system (20.7) under conditions (20.10) and (20.11) as @ varies. The 
initial conditions chosen at a = —5 were x g = —10 andy 9 = -3. 
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Figure 20.15 [Python] Bifurcation diagram for system (20.7) under conditions (20.10) and (20.11) as b 4 
varies. The initial conditions chosen at b 1 = —5 were x g = -10 and y g = -3. Ramp up in red and ramp 
down in blue. There is a large counterclockwise bistable cycle. 


20.5 Python Programs 


Comments to aid understanding of some of the commands listed within the 
programs. 
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Figure 20.16 Bifurcation diagrams for system (20.7) under conditions (20.10) and (20.11) as w 11 varies. 
The initial conditions chosen at w 11 = 7 were x ọ = -3 and y g = —2. There is a bistable region for 
approximately, 5.5 < w 11 < 7. 


Python Commands Comments 

datal[:, [5, 8, 12]] # Take data from columns 5, 8, 12. 
X.mean # Mean of data X. 

X.std # Standard deviation of data X. 


# Program 20a: The generalized delta learning rule. 
# See figure 20.7. 


import matplotlib.pyplot as plt 
import numpy as np 


se 


data = np.loadtxt(’housing.txt’ ) 
rows, columns = data.shape 


columns = 4 # Using 4 columns from data in this ca 


x = data[:, [5, 8, 12]] 


t = data[:, 13] 
ws1, ws2, ws3, ws4 = [], [], [], [] 
k = 0 


xmean = X.mean(axis=0) 

xstd X.std(axis=0) 

ones = np.array([np.ones(rows) ] ) 

X = (X - xmean ones.T) / (xstd  ones.T) 
X = np.c_[np.ones(rows), X] 


tmean = (max(t) + min(t)) / 2 
tstd = (max(t) - min(t)) / 2 
t = (t - tmean) / tstd 


= 0.1 * np.random.random(columns) 
np.tanh(X.dot(w) ) 

t = yi 

mse = np.var(e1) 


num_epochs = 10 # number of iterations 
eta = 0.001 
k=1 


for m in range(num_epochs): 
for n in range(rows): 
yk = np.tanh(X[n, :].dot(w)) 
err = yk - t[n] 
g = X[n, :].T * ((1 - yk**2) * err) 
w=w - eta*g 
k += 1 
wsi1.append([k, np.array(w[0]).tolist()]) 
ws2.append([k, np.array(w[1]).tolist()]) 
ws3.append([k, np.array(w[2]).tolist()]) 


ws4.append([k, np.array(w[3]).tolist()]) 


wsi = np.array(ws1) 
wS2 = np.array(ws2) 
wS3 = np.array(ws3) 
ws4 = np.array(ws4) 


plt.plot(wsi[:, ©], wsi[:, 1], ’k.’, markersize=0.1 
plt.plot(ws2[:, ©], ws2[:, 1], ’g.’, markersize=0.1 
plt.plot(ws3[:, ©], ws3[:, 1], ’b.’, markersize=0.1 
plt.plot(ws4[:, ©], ws4[:, 1], ‘’r.’, markersize=0.1 
plt.xlabel(’Number of iterations’, fontsize=15) 
plt.ylabel(’Weights’, fontsize=15) 


plt.tick_params(labelsize=15) 
plt.show() 


# Program 20b: The discrete Hopfield network. 
# See Example 5. 


from sympy import Matrix, eye 
import random 


# The fundamental memories: 


Sted i. ay. 

X2 Slt SAG. ely i,” | 
x3 = [-1;, i S11 Dy 

X = Matrix([x1, x2, x3]) 


X.T X/ 5 - 3eye(5) / 5 


def hsgn(v, x): 
if v > 0: 
return 1 
elif v == 0: 


return x 


else: 
return -1 
L = [0, 1, 2, 3, 4] 
n = random.sample(L, len(L)) 


Xinput = [1, -1, -1, 1, 1] 

xtest = xinput 

for j in range(4): 
M = W.row(n[j]) * Matrix(xtest) 
xtest[n[j]] = hsgn(M[O], xtest[n[j]]) 


if xtest == x1: 
print(’Net has converged to X1’) 
elif xtest == x2: 


print(’Net has converged to X2’) 
elif xtest == x3: 
print(’Net has converged to X3’) 
else: 
print(’Iterate again: May have converged to spu 
rious state’ ) 


“Net has converged to x2” 


# Program 20c: Iteration of the minimal chaotic neu 
romodule. 
# See Figure 20.13. 


import matplotlib.pyplot as plt 

import numpy as np 

# Parameters 

b1, b2, w11, w21, w12, a = -2, 3, -20, -6, 6, 1 
num_iterations = 10000 


def neuromodule(X): 
xX, Y=X 


xn=b1+w11/(1+np.exp(-a*x) )+w12/(1+np.exp(-a*y) ) 
yn=b2+w21/(1+np.exp(-a*x) ) 
return xn,yn 


for i in range(num_iterations): 
xn, yn = neuromodule( XO) 
X, Y =X + [xn], Y + [yn] 
XO = [xn, yn] 


fig, ax = plt.subplots(figsize=(8, 8)) 
ax.scatter(X, Y, color="blue’, s=0.1) 
plt.xlabel(’x’, fontsize=15) 
plt.ylabel(’y’, fontsize=15) 
plt.tick_params(labelsize=15) 
plt.show() 


# Program 20d: Bifurcation diagram of the neuromodu 
# See Figure 20.16. 


from matplotlib import pyplot as plt 
import numpy as np 


# Parameters 

b2, w11, w21, w12, a = 3, 7, 5, -4, 1 
start, max = -5, 10 

half_N = 1999 

N= 2 * half_N + 1 

N1 = 1+ half_N 

xs_up, XS_down = [], [] 

x, y = -10, -3 

ns_up = np.arange(half_N) 

ns_down = np.arange(N1i, N) 


# Ramp b1 up 
for n in ns_up: 
b1 = start + n*max / half_N 


x = b1 + w11 / (1 + np.exp(- 
a*x)) + w12 / (1 + np.exp(-a*y)) 
y = b2+w21 / (1 + np.exp(-a*x)) 
xn = X 
XS_up.append([n, xn]) 
xs_up = np.array(xs_up) 


# Ramp b1 down 

for n in ns_down: 
b1 = start + 2*max - n*max / half_N 
x = b1 + w11 / (1 + np.exp(- 

a*x)) + w12 / (1 + np.exp(-a*y)) 

y = b2 + w21 / (1 + np.exp(-a*x)) 
xn = X 
xs_down.append([N-n, xn]) 

xs_down = np.array(xs_down) 


fig, ax = plt.subplots() 
xtick_labels = np.linspace(start, max, 7) 
ax.set_xticks([(- 
start + x) / max * N1 for x in xtick_labels]) 
ax.set_xticklabels([’{:.1f}’.format(xtick) for xtic 
k in xtick_labels] ) 


plt.plot(xs_up[:, 0], xs_up[:, 1], ‘’r.’, markersize 
=0.1) 

plt.plot(xs_down[:, 0], xs_down[:,1], ‘’b.’, markers 
ize=0.1) 

plt.xlabel(r’$b_1$’, fontsize=15) 

plt.ylabel(r’$x_n$’, fontsize=15) 

plt.tick_params(labelsize=15) 

plt.show() 


20.6 Exercises 
1. For the following activation functions , show that 


(a) 


if Bv) = (1 +e %), then '(v) = ap) -(v)); 
b 
2 if O(v) = atanh(bv), then pv) = L(a? — f° (v)); 


c) if _., G cosh(a(v+1)) , then 
( ) Pv) — 2a log cosh(a(v-1)) 


d (v) = (tanh(a(v + 1)) — tanh(a(v — 1)))/2. 


2. 
Prove Theorem 2, showing that when the activation function is nonlinear, 


say, yy = É (vx), the generalized delta rule can be formulated as 


wen + 1) = wen) — 18x); 


where 
Od 
8xj = Ok- te) ae 


3. 
By editing the programs listed in Section 20.5: 


a 
A Investigate what happens to the mean squared error for varying 
eta values of your choice. 
(b) 
Investigate what happens to the mean squared error as the 
number of hidden neurons increases to five. 


4. 
Use another data set of your choice from the URL 


http://www.ics.uci.edu/~mlearn/MLRepository.html 
using an edited version of the programs listed in Section 20.5 to carry 
out your analysis. 


3. (a) 


(c) 


Prove Theorem 3 regarding Lyapunov functions of continuous 
Hopfield models. 

(b) Consider the recurrent Hopfield network modeled using the 
differential equations 


2 ; 2 s 
ý = -y + 6|- tan"! (= =2|- tan (=) , 
T 2 T 2 


Plot a vector field portrait and derive a suitable Lyapunov function. 


Plot surface plots for the Lyapunov functions for Examples 3 and 4 and 
Exercise 5(b). Plot the surfaces for | a ; | < 1,i = 1,2. 


Consider the discrete Hopfield model 
investigated in Example 5. Test the 
vector x 7 = (-1,-1, 1, 1, 1)", update in 
the following orders, and determine to 
which vector the algorithm converges: 


(a) 
x 3(1), x 4(1), x 5(1), x 2(1), X 
1(1); 

(b) 
x 11), x 4(1), x 3(1), x 2(1), x 
5(1); 


c) 
X 5(1), x 3(1), X 2(1), X 1(1), X 
4(1); 
(d) 
X 3(1), X 5(1), X 2(1), X 4(1), x 


1(1). 


Add suitable characters “3” and “5” to 
the fundamental memories shown in 
Figure 20.12. You may need to increase 
the grids to 10 x 10 and work with 100 
neurons. 


A simple model of a neuron with self- 
interaction is described by Pasemann 
[19]. The difference equation is given by 


An+1 = Yan +6 + wo (an), 0 < y < l, 


where a „is the activation level of the 
neuron, @ is a bias, w is aself-weight, y (b) 
represents dissipation in a neuron, and 

the output is given by the sigmoidal 
transfer function 


o(x) = EFE 


(c) 


Show that the system is unstable in the 
region bounded by the parametric 
equations: 


ha) = (1 -y)a + ; —, 
OMe Tota) (a) 

(d) bees 
Use the first iterative method to plot a 
bifurcation diagram when 0 = 4 and w = 
-16 for0<y<1. 

(e) ae 
Use the second iterative method to plot a 
bifurcation diagram when 0 = —2. 4 and 
y = 0 for 3 < w < 7. Ramp w up and 


Determine an equation for the 
fixed points of period one and 
show that the stability 
condition is given by | y + wo’ 
(a) | < 1, where a is a fixed 
point of period one. 
Show that the system is 
bistable in the region bounded 
by the parametric equations: 
(I-y) (l-7) 


, wa) = —. 


a 
(I-o(@) o'la) 


down. 


9. 
Consider the neuromodule defined by the equations 
Xn+1 = 2 + 3.5 tanh(x) — 4 tanh(0.3y),  Yn+1 = 3 + 5 tanh(x). 
Iterate the system and show that it is quasiperiodic . 

10. 

Use the OGY method to control chaos in the minimal chaotic 
neuromodule. 
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21. Binary Oscillator Computing 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To provide a brief historical introduction to binary oscillator computing. 
e To review basic operations of neurons. 
e To introduce threshold oscillatory logic and memory. 


On completion of this chapter, the reader should be able to 


e perform simple binary logic operations using threshold oscillators; 
e plot time series data to illustrate the functionality; 
e appreciate the potential applications of the devices in the real world. 


The work presented in this chapter is inspired by brain dynamics and has led 
to the submission of International, UK, and Taiwanese patents [16, 17, 19]. The 
author and co-inventor Jon Borresen are currently working with collaborators 
towards building superfast binary oscillator computers as well as assays for 
electrochemical cell degradation. 


21.1 Brain Inspired Computing 


As with Neural Networks, the subject of Chapter 20, the main ideas in this 
chapter are inspired by biological brain dynamics which will now be briefly 
discussed for completeness. Figure 21.1 shows a schematic of a neuron which is 
comprised of typical parts of cells with a few specialized structures that make it 
unique. The main part of the cell is the cell body (or soma) which contains the 
cell nucleus comprising genetic material in the form of chromosomes. Dendrites 
branch out from the cell body and it is primarily these spikes that receive 
chemical signals from other neurons. If the neuron fires, an electrochemical 


signal is transmitted along the axon to the axon terminals. Note that longer axons 
are usually covered with a myelin sheath that act in a similar manner to 
insulation around an electrical wire. In order for signals (or action potentials) to 
be transmitted from neuron to neuron, between the axon terminal and the 
dendrite of a connecting neuron there exists a very tiny membrane junction or 
gap called the synaptic gap (or cleft). 

As the signal reaches the axon terminal, tiny bubbles of chemicals called 
synaptic vesicles release their contents which diffuse across the gap to bind with 
specific receptors in the membrane of the adjoining neuron. The endogenous 
chemicals transmitted are called neurotransmitters which may be excitatory or 
inhibitory. Examples of excitatory neurotransmitters include glutamate (the most 
prevalent neurotransmitter in the brain), acetylcholine, aspartate, histamine, and 
noradrenaline, while GABA (y-aminobutyric acid, the second most prevalent 
neurotransmitter in the brain), glycine, and seratonin are inhibitory. Among the 
many neurotransmitters, note that certain neurotransmitters such as acetylcholine 
and dopamine have both excitatory and inhibitory receptors, so it is an 
oversimplification to label them in this way. It has been estimated that the 
typical human brain has approximately 80% excitatory and 20% inhibitory 
neurotransmitters. 


Dendrites 


Axon Terminals 


Myelin Sheath 


Cell Nucleus 


Figure 21.1 Schematic of a neuron . Notice how this figure is similar to that shown in Figure 20.1 for the 
neuronal mathematical model. 


A neuron’s membrane forms a barrier between the extracellular space around 
the cell and its intracellular fluid, and is selectively permeable to ions such as 
sodium (Na*), potassium (K+), and chlorine (C17). It is mostly permeable to 


K* ions, less so to Cl” ions, and a lot less to Na* ions. The voltage difference 
between the extracellular and intracellular spaces is typically between — 60mV 
and — 80mV for a neuron in a resting state. If a stimulus causes the membrane 
potential to reach — 50mV or above, then an action potential develops. A 


depolarization occurs whereby the Na* channels open and Na” begins to enter 
the cell, further depolarizing the cell. At the end of the depolarization phase the 


Na* channels become refractory and no more Na” ions enter the cell. The K* 


channels are then activated and K* ions start to leave the cell, a process called 
repolarization, and the membrane potential falls below the level of the resting 


potential where the membrane is actually hyperpolarized. The K* channels close 


and the Na* channels reset, while the extra K* ions in the extracellular space 
diffuse away and the resting membrane potential is finally reestablished. If the 
stimulus remains, then a series of action potentials (known as a spike train) is 
generated as shown in Figure 21.2. 
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Figure 21.2 [Python] Spike train of action potentials that travel down the axon. At the beginning of the 
action potential the Na” channels open and Na” ions move into the axon causing depolarization. 


Repolarization occurs when the K* channels open and K” ions move out of the axon. The signal travels 
down the axon to the axon terminal (see Figure 21.1) where it can trigger other neurons. 


In the simplest sense, neurons are either firing or not firing. Once the neuron 


has been sufficiently excited above some threshold (typically - 55 mV for 
human neurons), the cell fires, if the neuron does not reach this threshold, it will 
not depolarize or create an action potential. If the stimulus does not reach 
threshold, then the neuron does not fire. As the stimulus passes the threshold 
value and continues to rise, the neuron starts to fire and the amplitude of 
oscillation remains constant, hence the All or None principle of neuron firing. 
Note, however, as the stimulus increases (up to a limit) the frequency of 
oscillation increases. The reader can verify this by attempting one of the 
exercises in Section 21.6. 

The Hodgkin-Huxley Equations. In 1952, Alan Lloyd Hodgkin and 
Andrew Huxley were modeling the ionic mechanisms underlying the initiation 
and propagation of action potentials in the giant squid axon [14]. By treating 
each component of the excitable cell as an electrical element, and applying the 
conservation of electric charge on a piece of membrane, they were able to derive 
the following equation for membrane current density: 


iso x] tip +l 
= dt Na K Ls 


21.1 
me I % the total membrane current density, C is the membrane capacitance, V 
is the difference between the membrane potential and the resting potential, I ya is 
the sodium current, I , is the potassium current, and I ; is the leakage current. 
Using Ohm’s law, Hodgkin and Huxley were able to expand equation (21.1) to 
give: 
dV 


C = I — gya h (V — Vya) — ggn (V — Vg) - g1 (V — Vi), 
G 


21.2 
et V wa Vx Vz, C, and g ,; are all constants determined from experimental 
data, and g ya and g g are both functions of time and membrane potential. The 
three dimensionless quantities m, h, and n represent sodium, potassium, and 
leakage gating variables and evolve according to the differential equations: 


dm 


T 7 nml — m) -pnm 
d = al = h) — By,h 
d an ~ n) ~ Brn, 


(21.3) 


where aq ; and f ; are the transition rate constants for the i-th ion channel. The 
individual gates act in a similar manner to first order chemical reactions with 
two states. The rate constant a ; represents the number of times per second that a 
shut gate opens, and similarly, 6 ; represents the number of times per second that 


an open gate shuts. Based on experimental data, the following parameter values 
have been chosen to generate Figures 21.2 and 21.3: 


0.1(V +40) 


Am = Texp(-0.1V +40? Bm = 4exp(—0.0556(V + 65)), 
ay, = 0.07 exp(-0.05(V + 65)), Bn = Taco (21.4) 
On = eo Bn = 0.125 exp(-0.0125(V + 65)), 
and additionally, 
C = lyuFem’’, 
gL = 03 mmhocm”, gx = 36 mmhocm ”, gya = 120 mmhocm”, (21.5) 
V, = -54.402 mV, Ve = -77 mV, Vya = 50 mV. 


The Python program for producing Figures 21.2 and 21.3 is listed in 
Section 21.5. 
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Figure 21.3 [Python] The upper blue curve is the neuron action potential, the middle black, red and green 


curves are the gating variables m, h, and n for equations and parameters listed in equations (21.2) to (21.5), 
and the lower magenta curve displays the input current. 
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Figure 21.4 (a) Mathematical modeling of chemical excitation. The green trace depicts the action 
potential in the excitatory neuron, the magenta trace is the proportion of bound receptors, and the blue trace 


is the action potential of the postsynaptic neuron. (b) Mathematical modeling of chemical inhibition. The 
red trace depicts the action potential in the inhibitory neuron, the magenta trace is the proportion of bound 
receptors, and the blue trace is the action potential of the postsynaptic neuron. 


In 1994, Destexhe et al. [8] derived an efficient method for computing synaptic 
conductances based on chemical kinetics. Figure 12.4 shows the results of 
modeling chemical excitation and inhibition. In Figure 12.4(a), the upper green 
trace is the action potential of an excitatory neuron, the middle magenta trace 
depicts the ratio of excitatory conductance, and the lower blue curve shows that 
the postsynaptic neuron is firing. In Figure 12.4(b), the upper red trace is the 
action potential of an inhibitory neuron, the middle magenta trace depicts the 
ratio of excitatory conductance, and the lower blue curve shows that the 
postsynaptic neuron is switched off. Readers can reproduce these results in 
Python. 

In order to simplify the work to follow in this chapter the Fitzhugh-Nagumo 
system [11, 24], which is essentially a reduction of the Hodgkin-Huxley 
equations [14], will be used to model the action potential of a spiking neuron. 
The describing equations are: 


yv=C+vv-a)\l—-—v)-w, w=ev-yw), 


(21.6) 
where v is a fast variable (in biological terms - the action potential) and w 
represents a slow variable (biologically - the sodium gating variable). The 
parameters a, y, and € dictate the threshold, oscillatory frequency, and the 
location of the critical points for v and w. A neuron will begin to oscillate when 
the input current C is above a critical threshold C 7, say. Figure 21.5 shows a 
typical phase portrait and time series solution for the integrate and fire neuron 
when the critical point is at the origin. When the input current is below the 
threshold C ;, the solution quickly settles to the stable critical point at the origin 
and there is no oscillation. When the input current exceeds the threshold, then 
the neuron displays oscillatory behavior as in Figure 21.5(b). 
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Figure 21.5 (a) Typical phase portrait of a stable limit cycle for the Fitzhugh-Nagumo equation (21.6), 
there is also a critical point at the origin in this case. (b) Typical time series of an integrate and fire neuron 
for the variable v(t). 


21.2 Oscillatory Threshold Logic 


Computing using oscillators is not a new concept, indeed the first modern 
computers were made using vacuum tube oscillators, and oscillators in a variety 
of forms are integral components in many devices. The use of neural oscillators 
has also been widely studied; however, in all cases the method of computation is 
derived from concepts of biological neural encoding. Current research into 
encoding using neural oscillators is therefore spatio-temporal, rate, or more 
usually synchronization based [2, 31], and [39]. Borresen and Lynch [3, 4] have 
proposed using oscillators as the fundamental components of computing devices 
(with all the inherent dynamical richness that this provides) and designing them 
in such a way as to perform binary logic in an equivalent manner to standard 
transistor logic. In implementation, the oscillator will provide a binary output (1 
equivalent to an oscillator firing or 0 where the oscillator does not fire) and the 
output from a single oscillator can be interpreted in exactly the same way as that 
of a transistor. 

Threshold logic has been studied as an alternative to Boolean logic for some 
time. For many implementations this is advantageous, allowing for reduced 
component counts and/or number of logic levels, as the implementation of 
complex logical operations may be achieved using a single gate [34]. Threshold 
logic gates [23] have a set of inputs {I 4, I 2, ...I p}, weights {w 4, w 2, ...w „} and 


a binary output y. The output y is typically described by: 


y=% È wi); 
i=l 


where the function @ is an activation function (e.g., Heaviside, tanh, sigmoid, 
piecewise linear, low gain saturation, see Chapter 20) and the binary output 1 is 
defined at some threshold, y > T, say. 

Threshold logic implementation has not supplanted standard logic 
implementation in CMOS due to sensitivity to parameter changes and variable 
connection weights requiring very low tolerance engineering. Recent advances 
in nanotechnology, in particular, Resonant Tunneling Devices (RTD) [35] and 
memnristor devices [29] have the potential to overcome such concerns. 

A threshold oscillator is an oscillatory device that will begin oscillating when 
the input to the device is above a certain threshold. Below this level the 
oscillator remains in a resting state and gives no output. It is possible to use the 
output of one threshold oscillator as the input of another oscillator to cause the 
second oscillator to operate (excitation) and under certain circumstances, it is 
also possible to cause the input of one oscillator to suppress the output of another 
oscillator (inhibition), see Figure 21.4. 

There are numerous viable methods for implementing binary computation 
using threshold oscillators. In order to perform the logical operations it is 
necessary that either oscillators with differing thresholds be used or the 
connections to the oscillators be of differing weights. The latter method is used 
here as this mimics more closely biological neural systems, from where the idea 
originated. 

Logical operations can be performed in a similar manner to standard logic 
circuits; however, due to the threshold nature it is possible to formulate logical 
operations as solutions of sets of linear inequalities. For instance, the AND 
function can be replicated by a threshold oscillator with two inputs, where the 
input strengths are scaled such that the total input is only above threshold if both 
the inputs are on. For a single input or for no input the total input would be 
below threshold. Defining the inputs to the logical circuits in vector form and 
scaling the input strength to a binary 1 or 0, we write XI =I; + I, as the total 


input to the circuit. The threshold equations may be thus written as: 


rort=(5)-(5)-(9] Ylw<T oe 
fort =( 1] lw > T, 


where T is the oscillator threshold and w the coupling weight between the 
inputs and the oscillator performing the AND operation. Clearly the solution to 
the above system (21.7) is L < w < T. For the logical OR operation, the 


solution w > T would suffice. 

Using threshold oscillators in this manner it is straightforward to implement 
the logical NOT operation using a negative coupling strength; however, as the 
logical NOT is effectively redundant in more complex logically complete circuit 
design where NAND and XOR operations are used, all models using the latter 
formulations will be implemented. 

One of the simplest computing circuits is the binary half adder . The binary 
half adder gives the sum of two binary inputs as a two bit binary output. 
Standard transistor implementation of a binary half adder uses one XOR gate (to 
give the sum) and one AND gate (to give the carry). Implementation of this 
circuit using threshold oscillators can be achieved via a similar design, with two 
oscillators replicating the logical functions. The AND operation is implemented 
as described above and the XOR operation can be achieved using an OR 
operation (as above) with an additional connection from the AND oscillator, 
which in some way inhibits the operation of the OR oscillator if the AND 
oscillator is active. The method by which inhibition occurs would be dependent 
upon the oscillators being used to form the circuitry. 

Figure 21.6(a) demonstrates a viable circuit schematic for half adder 
implementation using two oscillators O ; and O , and two inputs I , and I >, 


which may themselves be the output from other oscillators in a more complex 
circuit. Schematically, the circuit design is not dissimilar to standard threshold 
logic half adders [22]; however, due to the nature of the connections between 
oscillators, implementation may be markedly different. If we consider oscillators 
with identical thresholds we will require that the coupling strength, w 4, say, 


from I , and I , to O , be sufficient to cause O , to oscillate for only one input 

and for the coupling strength, w 5, say, from I , and I , to O , to be sufficient for 
it to oscillate for two inputs. The additional connection x 4, say, from O 5 to O 4 
is inhibitory such that if O , is oscillating it suppresses O 4. Denoting the output 


from O as (),, the total input to O ; and O , are thus given by: 


O; = Y hyrs Os) 


OES i, (21.8) 


We can consider such a system as a set of linear inequalities with normalized 
input vectors J and threshold T requiring solutions of the form: 


fis 0 ym On eT 
-NO $ Iw <T 

ee a! 0 Ymi One Se 

tort =(5).(7 | ore 

on l Yi, Oare F 
ae | $ Iw >T. 


(21.9) 
Thus, for instance, for a total input of YJ = 1, only O , will be above threshold 


causing oscillation giving a binary equivalent output of 1. If both I, and I , are 
active, O , will oscillate but O ; is suppressed if Ô sx; > T/2 + w giving a 


binary output 1 + 1 = 10, as required. 

It is possible to couple the oscillators together via various methods. For 
biological neural systems, where there is synaptic coupling between neurons the 
coupling function is complex, relying on diffusion of neurotransmitters across a 
synaptic gap. The connections between neurons may either depolarize (excite) or 
hyperpolarize (inhibit) the postsynaptic neuron. 

Crucially, the hyperpolarizing inhibitory effect has a temporal component 
such that if inhibition occurs, the postsynaptic neuron remains inhibited for some 
period of time after the presynaptic neuron fires. It is not straightforward to 
simulate such a system using the Fitzhugh-Nagumo model without either 
integration of the signal pulse or introducing arbitrary conditions on oscillators 
receiving an inhibitory pulse - which would not be viable from an 
implementation perspective. As such a method which is phenomenologically 
similar to neural hyperpolarization is employed but is not necessarily consistent 
with any biological process. 

Implementation by coupling through either the fast v variable or the slow w 
variable is equally viable. Any coupling function to be used must take into 


account the specific dynamics of whichever variable is used. As is common in 
such biologically inspired models, a sigmoidal transfer function is applied 
between oscillators of the form: 


1 


S(x) E 1 + emCxte)’ 


(21.10) 
where c is the threshold at which the output begins to rise and m denotes the 
steepness of the curve of the function S(x). In biological systems, neural 
connections can exhibit plastic responses and become “tuned” (via some 
Hebbian learning rule [13]) allowing for more reliable excitation and inhibition. 
Choosing suitable values of m and c would in many respects replicate such a 
process. 
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Figure 21.6 [Python] (a) Schematic of a binary oscillator half adder comprising two inputs I 4 and I 2, two 
oscillators O 1 and O 9 and a set of excitatory synaptic connections with weights w 1, w 9, and an inhibitory 
connection with weight x 41. The sum oscillator O 1 will oscillate if either J 1 or I 7 are active. The carry 
oscillator O 9 will oscillate if both J 4 and I 9 are active. The inhibitory connection x 1 from O 2 to O 1 
suppresses oscillator O 1 if O 2 is active. (b) Time series showing that the half-adder is functioning 


correctly when the oscillations are simulated using Fitzhugh-Nagumo systems. Oscillations are equivalent 
to a binary one in these simulations and no oscillation is zero. 


Numerical simulations for systems of Fitzhugh Nagumo oscillators coupled as in 
Figure 21.6(a) will now be discussed. The inputs to the logical circuits are 
oscillatory, being provided by Fitzhugh-Nagumo oscillators with similar 


coupling and parameter values to the computational oscillators. Oscillatory 
inputs of this form have been chosen over continuous inputs, as this 
demonstrates the necessary robustness of signal integrity which would be 
required for larger computational circuits. Continuous inputs to the 
computational oscillators would be equally viable and present no difficulties in 
implementation. As such the matrix form for the input weights for each 
oscillator is 4 x 4 rather than 2 x 2 as two additional oscillators are used as 
inputs. One solution, in matrix form, to the inequalities (21.9) for the binary half 
adder would be: 


00 0.8 0.45 
00 0.8 0.45 
ie 00 0 0 
0 0 -1.5 0 


(21.11) 

where C = 0. 5 in equation (21.6) for the inputs I , and I 5. This would give the 
parameter values shown in Figure 21.6(a) as w ; = 0. 8, w = 0. 45 and x 4 = 1.5. 
The time series for such is shown in Figure 21.6(b) and the Python program is 
listed in Section 21.5. 

A two-oscillator binary full adder can be constructed by simply introducing 
another input, I 3, say, as in Figure 21.7(a), and Figure 21.7(b) shows the time 
series for the Fitzhugh-Nagumo two-oscillator full adder. Deriving the threshold 
inequalities for the full adder is left as an exercise for the reader (see 

Section 21.6). 
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Figure 21.7 (a) Oscillator circuit diagram for a binary full adder comprising three inputs I 14, I 2, and I 3 
and two oscillators O 4 and O 3. Oscillator O 1 will oscillate if either I 1, I 2, or I 3 are active. Oscillator O 
2 will oscillate if any two of I 4, I 2, and J 3 are active. An inhibitory connection from O 9 to O 1 suppresses 
oscillator O 1 if O 2 is active; however, the inhibition is only sufficient to suppress O 1 for JI = 2. For 
inputs of I = 3 the total input to O 4 is still sufficient to induce oscillation. (b) Time series for a Fitzhugh- 
Nagumo two oscillator full adder. All binary combinations of oscillatory inputs I 1, I 2, and I 3 give the 
required binary outputs for O 4 and O 9. 


In order to more fully demonstrate the applicability of binary oscillator 


computing more complex circuits, such as the three oscillator seven input full 
adder and the 2 x 2 bit binary multiplier may be constructed [4]. This is again 
left as an exercise for the reader (see Section 21.6). 
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Figure 21.8 (a) Schematic of an SR flip-flop for memory. (b) Time series of an SR flip-flop using single 
input pulses (ballistic propagation) to switch based on Fitzhugh-Nagumo oscillations. 


Figure 21.8(a) shows a schematic of a Set-Reset (SR) flip-flop circuit, the 


input I , is commonly referred to as the Set and input I 5 is referred to as the 
Reset. Output Ô, is the complement of output Ô. Note that both oscillators 


require a constant input I ç, say, for the circuit to function properly. This circuit 
acts as a memory, storing a bit and presenting it on its output Ô|, as can be seen 


in Figure 21.8(b). 

The SR flip-flop described here is an application of the “winnerless 
competition” principle. In the absence of coupling between the oscillators, both 
will remain active. However, a symmetric inhibitory coupling between them 
ensures that from an initial state, where only one oscillator is active, the other 
will remain suppressed in the absence of any external perturbation. When an 
input is given to the inactive oscillator this is switched on, simultaneously 
suppressing the previously active oscillator. When the external input is turned 
off, the system remains in the switched state. Note that for a switch to occur, an 
input pulse of only one period is required (see Figure 21.8(b)). Switching using a 
single pulse in this way can open an opportunity to use ballistic propagation of 
signals between gates and memory cells, which could significantly reduce the 
energy required to operate memory circuits, where currently power intensive line 
charging is required to initiate memory switches. One important consideration, 
particularly with respect to flip-flop circuits, is the ability to switch accurately in 
the presence of noise, and the authors have demonstrated that oscillator-based 
SR flip-flops are highly noise resistant [4]. 


21.3 Applications and Future Work 


In 1948, the world’s first successful program was run on Manchester 
University’s small-scale experimental machine the “Baby.” To mark the 50th 
anniversary, the museum of Science and Industry based in Manchester 
constructed a working replica which is still on display today. In 1951, 
Manchester University in partnership with Ferranti Limited built the world’s first 
commercially available general-purpose computer, the Ferranti Mark 1. Given 
that one of the principal components in those machines was the vacuum tube 
oscillator (see Chapter 5) and the fact that the most powerful computer, the 
brain, also works with threshold oscillators, then the proposition of building 
modern computers using naturally oscillating devices should come as no 
surprise. 

There are potentially five major avenues of research for binary oscillator 
computing which are listed below: 


c= VU 


e Josephson Junction (JJ) Oscillators. JJs are superconducting natural 
threshold oscillators that cycle one hundred million times faster than 
biological neurons. The inventors are currently working with collaborators 
based at Colgate University and HYPRES Inc., both based in New York in the 
USA. 

e Biological Neuron Oscillators. The inventors are currently working with cell 
biologists, stem cell researchers and engineers in order to build the world’s 
first assay for neuronal degradation. It is likely that further patents will be 
applied for as these biological logic circuits are built and further details will 
be published once the work is protected. See Section 21.4. 

e CMOS Oscillators. In 2011, Manchester Metropolitan University employed a 
SPICE (Simulation Program with Integrated Circuit Emphasis) modeler to 
simulate the binary half adder circuits using CMOS-based oscillators and the 
simulations produced the required output [16]. Once more, the inventors are 
seeking industrial partners and results will be published at a later date. 

e Memristors. Memristor circuits can be built to make neuristors [28] (they 
mimic neurons), and axons and synapses are natural memristors. It is believed 
that highly connected neuronal circuits can be fabricated using memristors. 

e Optical Oscillators. This avenue of research has yet to be pursued but 
interested readers should consult [12] where photonic synapses are employed 
for brain-like computing. 


Currently, the inventors are pursuing two of the avenues of research highlighted 
above, namely JJ and biological neuron computing. The biological neuron 
oscillators will be used to make an assay for neuronal degradation and results 
and patents will follow. The oscillators depicted in Figures 21.6 to 21.8 could be 
fabricated using biological neurons, memristors, transistor circuits, all-optical 
circuits, or from JJ circuits [16]. JJs are natural threshold oscillators and 
unsurprisingly they can be designed to act like biological neurons with 
excitatory or inhibitory connections between them [20, 21, 22, 23, 24, 25, 26]. 
Crotty et al. [6] have even suggested that JJ neuronal circuits could be built to 
model parts of the brain. Superconductive computing based on Rapid Single 
Flux Quantum (RSFQ) technology is at an advanced stage and has already 
produced practical digital and mixed-signal circuits with world record 
processing speeds at exceptionally low power [10, 11, 12, 13, 14, 15, 16, 17, 18, 
19, 20, 21]. An 8-bit high frequency RSFQ-based arithmetic logic unit (ALU) 
was fabricated with HYPRES’ standard 4. 5kAcm “ process and consisted of 
7950 JJs, including input and output interfaces. A high performance ALU is a 


fundamental building block for any computer processor and we now demonstrate 
how threshold oscillatory logic could help to further improve on this JJ 
performance. HYPRES foundry is producing complex digital RSFQ circuits 
operating at tens of gigahertz clock speed. Small RSFQ circuits were 
demonstrated to operate up to 770 GHz. As far as energy consumption is 
concerned, the current industry best for CMOS is approximately 1. 7 
GFLOPS/Watt compared with a potential 5|00 GFLOPS/Watt for JJ circuits. As 
well as a linear increase in components using binary oscillator logic described 
here [4], there are no migration issues and a proven radiation hardness with JJs. 
In 2005, the US National Security Agency published a report entitled 
“Superconducting Technology Assessment” [25] written by experts in the field. 
The authors concluded that transistors were rapidly approaching the limits of 
functionality and that the most likely successor to that technology would be 
based on JJs. They surmised that, given the investment required, a true petascale 
computer could be built by 2012. This chapter demonstrates how coupled 
threshold oscillators may be used to perform both binary logic and memory in a 
manner entirely consistent with modern architectures. The benefits of using JJ- 
based components in terms of speed and energy usage are well documented. The 
additional benefits of JJ oscillator based computing include a doubling of 
processing power with a linear increase in components as well as ballistic 
propagation-based data interconnect between processor and memory. By 
utilizing some of the dynamics of the brain and using JJ circuitry it should be 
possible to build a true exascale supercomputer based on this technology. In a 
recent development, Ken Segall et al. [30] have demonstrated synchronization 
dynamics on the picosecond timescale for physical JJ circuits acting like 
neurons. We are currently working with Ken in an attempt to build prototypes of 
our patented circuitry. We expect that the problem of fan-in and fan-out 
(connecting to and from JJ neurons) will be addressed using either low power 
memnistor cross-bar lattices [33] or low power graphene nano-ribbon electronics 
[5]. 

To conclude this section, simple mathematical models of a JJ anda 
memristor (see Chapter 8) will be presented. 

Mathematical Model of a JJ. A JJ with two superconducting layers 
sandwiching an insulating layer will be investigated. The differential equation 
used to model the resistively shunted JJ is written as 

d d 
— T + sing =K, 


91 19% 


(c1.1-) 


where @ is a phase difference, B ; is a parameter inversely related to the 
Josephson plasma frequency œw ,, K is related to the total current across the 
junction, and 


Let ¢¢ _ Q, then the second order ODE (21.12) can be written in the form 


dt 


dQ 
Z =Q, — =K-p;Q-smø, 
dr dt 
(21.13) 


where n = P ; Q, is proportional to voltage. When xK = f ; = 0, then system 
(21.13) represents a Hamiltonian system given by 
fa 


Q 
H(¢, Q) = z cos ġ. 


Note that the Hamiltonian is very similar to that for the simple nonlinear 
pendulum depicted in Figure 6.1 and the trajectories are similar to those 
displayed in Figure 6.2. Note that the resistively shunted JJ acts as a threshold 
oscillator. Figure 21.9 shows a limit cycle when k = 2, when f ; = 1. 2. 

A Python program for plotting Figure 21.9 is listed in Section 21.5. There is also 
a Python program listed that shows an animation of the bifurcating limit cycle. 
The tunneling JJ also displays hysteresis as shown in Figure 21.10, which shows 
a typical I-V (x-(n)) characteristic curve for a tunneling JJ as the voltage is 
increased and decreased. When (7) = 0, Josephson current ( up to a maximum 


threshold value, Z.) flows. A direct current (DC) Josephson supercurrent flows 


under <n) = 0. When the current exceeds I „ there is a bifurcation to an 
oscillating tunneling current. As (7) is increased further, the relation x = (n) 
holds valid. As the voltage (7) is decreased, the relation x = (7) still holds until a 
point where x ,. % 0. 6965, and (n) = 24, where A is an energy gap of the 
superconductor, where there is a bifurcation from oscillatory behavior back to 
the zero-voltage state. Note that the normalized DC voltage (n) = B <Q), where 


(Q), is the average of the maximum and minimum values of Q in the long t 


region. 
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Figure 21.9 [Python plot and animation] A limit cycle in a resistively shunted JJ. 


Mathematical Model of a Memristor. The memristor was briefly discussed in 
Chapter 8. A simple mathematical model will be presented in this section and a 
Python program for plotting a pinched hysteresis loop will be listed in 

Section 21.5. Figure 21.11 depicts a titanium dioxide memristor which was first 
presented by Hewlett-Packard Laboratories in 2008 (see reference [11] in 
Chapter 8). The instantaneous resistance M(w) of the memristor is given by 


w w 
M(w) = pron + ( = =) Rorr: 


(21.14) 
where Roy and Ropr are the resistances of the completely doped and the 


undoped memristor, respectively. Suppose that D = 1, then the speed of dopant 
movement is expressed as 


x1 


2A/e 


(n) 


Figure 21.10 A typical I-V characteristic curve usually observed in a tunneling JJ. The blue curve shows 
the current for increasing voltage and the red curve depicts current for decreasing voltage. There is a 
clockwise hysteresis cycle. Note that , — ri and the average voltage, (n) = B j(Q). 
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Figure 21.11 Abstract structure of a two terminal titanium dioxide (TiO) HP Labs memristor. 


dw nf (w(t), p)vo sin (=) 


dt 7 wRon + (1 - w)Rorr cee 


where ņ is the polarity of the memristor (if n = +1, then w increases with positive 
voltage), v 9 is the voltage amplitude, and the function, f(w(t), p) = 1 - w(t) - 


1)*P, is the window function for the nonlinear dopant drift. The differential 
equation has initial condition w 9 = w(0). 
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Figure 21.12 [Python] Pinched hysteresis (voltage against current) of a memristor for a sinusoidal wave 


input voltage v(t) = vo sin (z) . The memristors parameters are D = 1, Roff = 70, Ron = 1, n = 1, p= 


10, vg = 1, T = 20, and f(w, p) = 1 - (2w - 1)2P. (a) When w g = 0. 5; (b) when w g = 0.6. 


The differential equation (21.15) can be solved with Python (see 
Section 21.5) and the voltage against current pinched hysteresis loop can be 
plotted. Two pinched hysteresis loops are shown in Figure 21.12. 

The author and Borresen believe that JJ neurons can be connected together 
using memristors as axons and synapses. This is another avenue for research. 


21.4 An Assay for Neuronal Degradation 


There are estimated to be over five hundred neurological conditions and 
disorders that affect the human brain, spine, and nerves that connect them. These 
conditions include Alzheimer’s disease, autism, epilepsy, multiple sclerosis, and 
Parkinson’s disease , for example. In 2005, the World Health Organization 
(WHO) estimated that neurological disorders affected more than one billion 
people worldwide. Just one of these disorders, Alzheimer’s disease (the most 
common form of dementia) currently has no cure and it is estimated that 1. 2% 
of the world’s population will be affected by 2050. Growing cells atop multi- 
electrode arrays (MEA ) is now a well-established practice and these devices 
enable fundamental neurophysiological insights at both the circuit and cellular 
level. The author and his collaborators are proposing to build assays for neuronal 
degradation where the functionality of the neurons and neural networks will be 
known. The assays will consist of healthy/diseased logic and memory circuits 
composed of biological neurons. These assays could have major implications for 
the UK NC3Rs agenda of Replacing, Reducing and Refining the use of animals 
for scientific testing. As long ago as 2005, C. Wyart [36] and her group devised 
a new technique to control the architecture of neuronal networks in vitro. 

Figure 21.13 shows a magnification of individual neurons sitting atop a multi- 
electrode array, where the black lines and circles are the electrodes, the bright 
lights are neurons, which are linked by axons. Figure 21.14 shows the MEA 
apparatus for recording electrical activity of neurons. The device is connected to 
a computer where the user can send electrical signals to electrodes and also 
record electrical activity at the same time. The computer screen displays some 
output from electrodes - the spike trains are similar to those shown in 

Figure 21.2. 


Figure 21.13 A magnification of individual neurons sat atop an MEA. Used with the permission of C. 
Wyart. 


Figure 21.14 The multi-electrode array apparatus connected to a computer monitor. Note the spike trains 
on the computer screen, these indicate that some of the neurons are firing. 


The author is currently working with Jon Borresen and Mark Slevin 
(Manchester Metropolitan University, UK), in collaboration with Paul Roach 
(University of Loughborough, UK) and Mark Kotter (University of Cambridge, 
UK) to build an assay for neuronal degradation. Paul Roach and his team 
manufacture platforms for connecting neurons that can be placed on MEAs, and 
Mark Kotter and his group are able to grow neurons using stem cell research. 


Mark Slevin is a professor of cell biology and specializes in Alzheimer’s 
disease. The idea is to build logic and memory circuits from diseased neurons 
and test which drugs best preserve the functionality of the circuits 

(Figure 21.14). 

In 2002, Zemelman et al. [38] developed a method for stimulating 
genetically modified neurons using light and this has led to the field of research 
known as optogenetics . The field of optogenetics is quickly moving beyond 
proof of concept and is finding applications in cell signaling, biophysical 
modeling, and systems biology, see [32] for a review up to 2014. In the future, 
we will build threshold oscillator logic and memory circuits using genetically 
modified neurons, where neurons will be stimulated with light, and excitatory 
neurons will glow green and inhibitory neurons will glow red. 

Results of this research will be published at a later date. 


21.5 Python Programs 


# Program 21a: The Hodgkin-Huxley Equations. 
# See Figures 21.2 and 21.3. 


import numpy as np 
import matplotlib.pyplot as plt 
from scipy.integrate import odeint 


onstants 
= 1.0 # uF/cm^2 
a= 120.0 # mS/cmA2 


See equations (21.4) 
ef alpha_m(V): return 0.1 (V+ 40.0) / (1.0 - np.exp 
0.1 


(V + 40.0))) 


# 
C_ 
g_ 
g_ 
g_ 
V_ 
V_ 
V_ 
# 
d 
(- 
def beta_m(V): return 4.0 np.exp(-0.0556 (V + 65.0) 
) 


def alpha_h(V): return 0.07 np.exp(-0.05 (V + 65.0)) 
def beta_h(V): return 1.0 / (1.0 + np.exp(-0.1 * (V + 
35.0))) 
def alpha_n(V): return 0.01 * (V + 55.0) / (1.0 - np.e 
xp(-0.1 * 

(V + 55.0))) 
def beta_n(V): return 0.125 * np.exp(-0.0125 * (V + 6 


5) ) 


# See equation (21.2) 

def I_Na(V,m,h): return g Na * m**3 h (V - V_Na) 
def I_K(V, n): return g K n*4 * (V - V_K) 

def I_L(V): return g_L * (V - VL) 


# Input current 
def Input_current(t): return 10 (t > 100) - 10 (t > 
200) + 25 * 

(t > 300) 


t = np.arange(0.0, 400.0, 0.1) 


# Set up the ODEs, see equations (21.3) 
def hodgkin_huxley(X, t): 
V,m h, n= X 
dVdt = (Input_current(t) - I_Na(V, m, h) - I_K(V, 
n) - 
I_L(V)) 7 Cm 


dmdt = alpha_m(V) * (1.0 - m) - beta_m(V) * m 
dhdt = alpha_h(V) * (1.0 - h) - beta_h(V) * h 
dndt = alpha_n(V) * (1.0 - n) - beta_n(V) * n 


return (dVdt, dmdt, dhdt, dndt) 


© = [-65, 0.05, 0.6, 0.32] 
odeint(hodgkin_huxley, y0, t) 
x[: 


STs < x< 
Hod i ou ul 
x< 


y 

4 
X[:, 2] 

1 


ina = I_Na(V, m, h) 


I_K(V, n) 
I_L(V) 


plt.subplots_adjust(hspace = 1) 
plt.figure(1) 


plt.subplot(5, 1, 1) 
plt.title(’Hodgkin-Huxley Neuron’) 
plt.plot(t, V, ‘b’) 
plt.ylabel(’V (mV)’) 


plt.subplot(5, 1, 2) 
plt.plot(t, m, ‘k’) 
plt.ylabel(’m(V)’) 


plt.subplot(5, 1, 3) 
plt.plot(t, h, ‘r’) 
plt.ylim(0, 1) 
plt.ylabel(’h(V)’) 


plt.subplot(5, 1, 4) 
plt.plot(t, n, ‘g’) 
plt.ylim(0, 1) 
plt.ylabel(’n(V)’) 


plt.subplot(5, 1, 5) 

plt.plot(t, Input_current(t), ‘’m’) 
plt.ylabel(’Input current’) 
plt.xlabel(’Time (ms)’ ) 
plt.ylim(-1, 31) 


plt.show() 


# Program 21b: The Fitzhugh-Nagumo Half -Adder. 
# See Figure 21.6. 


import numpy as np 
import matplotlib.pyplot as plt 
from scipy.integrate import odeint 


# Input current 

def input_1(t): return 1 * (t > 500) - 1 (t>1000) 
+1 (t > 1500) 

def input_2(t): return 1 * (t > 1000) 


# Constants 
theta = gamma = epsilon = 0.1 
tmax, m, c = 2000, -100, 60 


t = np.arange(0.0, 2000.0, 0.1) 


def fn_odes(X, t): 
u1, v1, u2, v2, u3, v3, u4, Wa = X 
dui = - 
ul * (ul - theta) * (ul - 1) - vi + input_1(t) 
dvi = epsilon * (u1 - gamma * v1) 
du2 = 
u2 * (u2 - theta) * (u2 - 1) - v2 + input_2(t) 


dv2 = epsilon * (u2 - gamma * v2) 

du3 = -u3 * ((u3 - theta) * (u3 - 1) - v3 + 0.8 
/ (1 + np.exp(m*v1i + c)) + 0.8 
/ (1 + np.exp(m*v2 + c)) - 1.5 
/ (1 + np.exp(m*v4 + c))) 

dv3 = epsilon (u3 - gammav3) 

du4 = (-u4 (u4 - theta) (u4 - 1) - v4 + 0.45 


/ (1 + np.exp(m*v1 + c)) + 0.45 
/ (1 + np.exp(m*v2 + c))) 
dv4 = epsilon (u4 - gamma v4) 
return (dui, dvi, du2, dv2, du3, dv3, du4, dv4) 


yO = [0.01, 0.01, 0.01, 0.01, ©, 0, ©, 0] 

X = odeint(fn_odes, yO, t, rtol=1e-6) 

u1, vi, u2, v2, u3, v3, u4, v4 = X.T # unpack colu 
mns 


plt.subplots_adjust(hspace=1) 
plt.figure(1) 


plt.subplot(4, 1, 1) 


plt.title(’Fitzhugh-Nagumo Half -Adder’ ) 
plt.plot(t, u1, ‘b’) 

plt.ylim(-1, 1.5) 

plt.ylabel(’I$_1$’ ) 


plt.subplot(4, 1, 2) 
plt.plot(t, u2, ‘b’) 
plt.ylim(-1, 1.5) 
plt.ylabel(’I$_2$’ ) 
plt.subplot(4, 1, 3) 
plt.plot(t, u3, ‘’g’) 
plt.ylim(0, 1) 
plt.ylim(-1, 1.5) 
plt.ylabel(’0$_1$’ ) 


plt.subplot(4, 1, 4) 
plt.plot(t, u4, ‘g’) 
plt.ylim(-1, 1.5) 
plt.ylabel(’0$_2$’ ) 
plt.xlabel(’Time’ ) 


plt.show() 


# Program 21c: Josephson junction limit cycle. 
# See Figure 21.9. 


from matplotlib import pyplot as plt 
import numpy as np 
from scipy.integrate import odeint 


fig = plt.figure() 


bj = 1.2 
tmax = 100 
kappa = 1.4 


def jj_ode(x, t): 
return [x[1], kappa - bj*x[1] - np.sin(x[0])] 


time = np.arange(0, tmax, 0.1) 


nN rN a A at 


XU=|U.1,U.1] 
xs = odeint(jj_ode, x0, time) 
imgplot = plt.plot(np.sin(xs[:, 0]), xs[:, 1], ‘r-’ 


plt.xlabel(r’$\sin(\phi)$’, fontsize=15) 
plt.ylabel(r’$\Omega$’, fontsize=15) 
plt.tick_params(labelsize=15) 

plt.show() 


# Program 21d: Animation of a JJ limit cycle bifurc 
ation. 
# See Figure 21.9. 


from matplotlib import pyplot as plt 

from matplotlib.animation import ArtistAnimation 
import numpy as np 

from scipy.integrate import odeint 


fig = plt.figure() 
myimages = [] 


bj = 1.2 
tmax = 100 


def jj_ode(x, t): 
return [x[1], kappa - bj*x[1] - np.sin(x[0])] 


time = np.arange(0, tmax, 0.1) 
x® = [0.1, 0.1] 
for kappa in np.arange(0.1, 2, 0.1): 
xs = odeint(jj_ode, x0, time) 
imgplot = plt.plot(np.sin(xs[:, 0]), xs[:, 1], 
‘r-') 
myimages.append(imgplot ) 


my_anim = ArtistAnimation(fig,myimages, interval=100 
,olit=False, 
repeat_delay=100 ) 
plt.show() 


# Program 21e: Pinched hysteresis in a memristor. 
# See Figure 21.12. 


import numpy as np 
import matplotlib.pyplot as plt 
from scipy.integrate import odeint 


# Constants 
eta, L, Roff, Ron, p, T, wO = 1.0, 1.0, 70.0, 1.0, 


10.0, 20.0, 0.5 


t=np.arange(0.0, 40.0, 0.01) 


# Set up the ODEs, see equations (21.3) 
def memristor(X, t): 
w= X 
dwdt = ((eta (1 - (2w - 1) ** (2*p)) np.sin(2 


np.pi * t/T)) 


/ (Roff - (Roff - Ron) * w)) 
return dwdt 


odeint(memristor, [w0], t, rtol=1e-12) 
X[:, 0] 


plt.plot(np.sin(2*np.pi t/T), np.sin(2np.pi * t/T) 
/ (Roff - (Roff - Ron) * X[:, O]), ‘b’) 

plt.xlabel(’voltage’, fontsize=15) 

plt.ylabel(’current’, fontsize=15) 

plt.tick_params(labelsize=15) 

plt.show() 


21.6 Exercises 


1. 


Approximate the threshold input, J, for the Hodgkin-Huxley equations 
described by equations (21.2) to (21.5). Determine the frequency of spiking 
when (a) J = 8 mV, and (b) I = 20 mV. 


Determine a Fitzhugh-Nagumo system (see equation (21.6)) that has a 
critical point at the origin. 


Using a similar notation used in equation (21.9) for the half-adder, 
determine the set of corresponding linear inequalities for the binary 
oscillator full-adder depicted in Figure 21.7(a). 


Write a Python program to produce time series of the Fitzhugh-Nagumo 
two oscillator full-adder as depicted in Figure 21.7. 


Write a Python program to produce a time series of the Fitzhugh-Nagumo 
seven input three oscillator full adder as depicted in Figure 21.15. 


Figure 21.15 Schematic of a seven input, three oscillator full adder. 


Write down the truth table for a 2 x 2 bit binary multiplier and use the 
schematic shown in Figure 21.16 to produce a time series for a 2 x 2 bit 
Fitzhugh-Nagumo binary multiplier. 


Figure 21.16 Schematic of a 2 x 2 bit multiplier based on standard circuitry. 


7. 
Write a Python program to produce a time series of the Fitzhugh-Nagumo 
SR flip-flop as depicted in Figure 21.8. 
8. 
Show that the Fitzhugh-Nagumo SR flip-flop modeled in the previous 
exercise is resistant to noise. 
9. 
Plot the trajectories for the Hamiltonian modeling the resistively shunted JJ 
system (21.14) when k = f ; = 0, given by 
Q? 
H(¢, Q) = a cos ġ. 
10. 
Use Python to plot the hysteresis curve displayed in Figure 21.10. 
Bibliography 
[1] P. Ashwin and J. Borresen, Encoding via conjugate symmetries of slow oscillations for globally 
coupled oscillators. Phys Rev E (2004) 70:026203. 
[MathSciNet][Crossref] 
[2] A.K. Barreiro, E. Shea-Brown, and E.L. Thilo, Time scales of spike-train correlation for neural 
oscillators with common drive. Phys Rev E (2010) 81:011916. 
[Crossref] 
[3] J. Borresen and S. Lynch, Neuronal computers, Nonlinear Anal. Theory, Meth. and Appl., 71 (2009), 


2372-2376 
[Crossref] 


[4] 


[5] 


[6] 


[7] 


[8] 


[9] 


[10] 


[11] 


[12] 


[13] 


[14] 


J. Borresen and S. Lynch, Oscillatory threshold logic, PLoS ONE 7(11): e48498. 
doi: 10.1371/journal.pone.0048498 (2012). 


Z. Chen, Y.M. Lin, M.J. Rooks, et al., Graphene nano-ribbon electronics, Physica E Low-Dimensional 
Systems and Nanostructures, 40 (2007), 228-232. 
[Crossref] 


P. Crotty, D. Schult and K. Segall, Josephson junction simulation of neurons, Phys. Rev., 82, 011914, 
2010. 


S.K. Dana, D.C. Sengupta and Hu Chin Kun, Spiking and bursting in Josephson junction, IEEE 
Transactions on Circuits and Systems 11-Express Briefs, 10 (2006), 1031-1034. 
[Crossref] 


A. Destexhe, Z.F. Mainen and T.J. Sejnowski, An efficient method for computing synaptic 
conductances based on a kinetic model of receptor binding, Neural Computation 6, (1994), 14-18. 
[Crossref] 


T. Filippov, M. Dorojevets, A. Sahu, A.F. Kirichenko, C. Ayala and O. Mukhanov, 8-bit 
asynchronous wave-pipelined RSFQ arithmetic-logic unit, IEEE Trans. on Applied Superconductivity, 
21 (2011) pp 847-851. 

[Crossref] 


T. Filippov, A. Sahu, A.F. Kirichenko, I.V. Vernik, M. Dorojevets, C.L. Ayala and O. Mukhanov, 20 
GHz operation of an asynchronous wave-pipelined RSFQ arithmetic-logic unit, Physics Procedia, 36 
(2012), 59-65. 

[Crossref] 


R. Fitzhugh, Impulses and physiological states in theoretical models of nerve membranes, Biophys., 
1182, (1961) 445—466. 


B. Gholipour, P. Bastock, C. Craig, K. Khan, D. Hewak and C. Soci, Amorphous metal-sulphide 
microfibers enable photonic synapses for brain-like computing, Advanced Optical Materials 3 (2015), 
635-641. 

[Crossref] 


D.O. Hebb, The organization of behaviour: A Neurophysiological Theory, Wiley, New York, 1949. 


A.L. Hodgkin and A.F. Huxley, A qualitative description of membrane current and its application to 
conduction and excitation in nerve, J. Physiol. 117 (1952), 500-544, 1952. Reproduced in Bull. Math. 
Biol., vol. 52, (1990) pp 25-71. 

[Crossref] 


[15] A.F. Kirichenko, S. Sarwana, D. Gupta, I. Rochwarger and O. Mukhanov, Multi-channel time 


[16] 


[17] 


digitizing system, IEEE Trans. Appl. Supercond., 13 (2003), 454—458. 
[Crossref] 


S. Lynch and J. Borresen, Binary Half Adder using Oscillators, International Publication Number, WO 
2012/001372 A1, (2012) 1-57. 


S. Lynch and J. Borresen, Binary Half Adder and Other Logic Circuits, UK Patent Number, GB 
2481717 A, (2012) 1-57. 


[18] 


[19] 


[20] 


[21] 


[22] 


[23] 


[24] 


[25] 


[26] 


[27] 


[28] 


[29] 


[30] 


[31] 


[32] 


S. Lynch and J. Borresen, Josephson junction binary oscillator computing, Proceedings of the IEEE 
International Superconductive Electronics Conference, Cambridge, Massachusetts, (2013), 1-3. 


S. Lynch, J. Borresen and M.A. Slevin (2016) US Patent: Assay utilising cellular binary half-adder 
system, Patent Application Number 14/230,511, Publication Number US9274096 B2. 


O.A. Mukhanov and V.K. Semenov, Reproduction of the Single Flux Quantum pulses in Josephson 
junction systems. II. Neuristor lines and logic elements, Mikroelektronika [Sov. Microelectronics], 17 
(1988), 155-161. 


O.A. Mukhanov and S.V. Rylov, Time-to-Digital converters based on RSFQ digital counters, IEEE 
Trans. Appl. Supercond., 7 (1997), 2669-2672. 
[Crossref] 


S. Muroga, Threshold Logic and Its Applications, Wiley, New York, 1971. 
[zbMATH] 


W. McCulloch and W. Pitts, A logical calculus of the ideas imminent in nervous activity, Bull Math 
Biophys (1943) 5:115-133. 
[MathSciNet][Crossref] 


J. Nagumo, S. Arimoto, and S. Yoshizawa, An active pulse transmission line simulating 1214-nerve 
axons, Proc. IRL 50, (1970) 2061-2070. 


National Security Agency, Superconducting Technology Assessment report, available: www.nitrd. 
gov/PUBS/nsa/sta.pdf, 2005 [April 30, 2014]. 


T. Onomi, Y. Maenami and K. Nakajima, Superconducting neural network for solving a combinatorial 
optimization problem, IEEE Trans. Appl. Supercond., 21 (2011), 701-704. 
[Crossref] 


T. Ortlepp, O. Wetzstein, S. Engert, J. Kunert and H. Toepfer, Reduced power consumption in 
superconducting electronics, IEEE Trans. on Applied Superconductivity, 21 (2011), 770-775. 
[Crossref] 


M.D. Picket, G. Medeiros-Ribeiro and R.S. Williams, A scalable neuristor built with Mott memristors 
Nature Materials, 12, 114, 2013. 


J. Rajendran, H. Manem, R. Karri, and G.S. Rose, An energy efficient memristive threshold logic 
circuit, IEEE Trans on Computers, (2012) 61:474—487. 
[MathSciNet][Crossref] 


K. Segall, M. LeGro, S. Kaplan et al., Synchronization dynamics on the picosecond timescale in 
coupled Josephson junction neurons, Phys. Rev. E 95, (2017), 032220. 


R.M. Smeal, G.B. Ermentrout, and J.A. White, Phase response curves and synchronized neural 
networks, Phil Trans R Soc B. 365 (1551) (2010), 2402-2407. 
[Crossref] 


D. Tischer and O.D. Weiner, Illuminating cell signalling with optogenetic tools, Nature Reviews 
Molecular Cell Biology 15 (2014), 551-558. 


[33] 


[34] 


[35] 


[36] 


[37] 


[38] 


[39] 


[Crossref] 


S. Vaidyanathan (Editor)and C. Volos (Editor), Advances in Memristors, Memristive Devices and 
Systems (Studies in Computational Intelligence), Springer, New York, 2017 


R. Waser R, Nanoelectronics and Information Technology, Wiley, New York, 2012. 


Y. Wei and J. Shen J, Novel universal threshold logic gate based on RTD and its application, 
Microelectronics Journal, (2011) 42:851-854. 
[Crossref] 


C. Wyart, C. Ybert, C. Douarche, C. Herr, D. Chatenay, L. Bourdieu (2005) A new technique to 
control the architecture of neuronal networks in vitro, Poindron P, Piguet P, Forster E (eds): New 
Methods for Culturing Cells from Nervous Tissues. BioValley Monogr. Basel, Karger, 1: 23-57. 


M. Zanin, F. Del Pozo, and S. Boccaletti, Computation emerges from adaptive synchronization of 
networking neurons, PloS ONE (2011), 11: e26467. 
[Crossref] 


B.V. Zemelman, G.A. Lee, M. Ng, G. Miesenbock, Selective photostimulation of genetically charged 
neurons, Neuron 33, (2002), 15-22. 


X. Zhang, R. Wang, Z. Zhang, J. Qu, J. Cao, et al., Dynamic phase synchronization characteristics of 
variable high-order coupled neuronal oscillator population, Neurocomputing, 73 (13-15) (2010), 
2665-2670. 

[Crossref] 


© Springer International Publishing AG, part of Springer Nature 2018 
Stephen Lynch, Dynamical Systems with Applications using Python 
https://doi.org/10.1007/978-3-319-78145-7_22 


22. Coursework and Examination-Type 
Questions 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


Aims and Objectives 


e To model real-world problems. 
e To investigate data generated by Python. 
e To use Python in an examination environment. 


On completion of this chapter, the reader should be able to 


e write Python programs to solve real-world problems; 
e give a physical interpretation of the results; 
e use Python to solve examination questions. 


This chapter provides examples of both coursework questions and 
examination questions that I have used with my students for nearly two decades. 
Most of the coursework questions require programming in Python and are 
unsuitable for an examination environment. The examination questions require 
the use of Python as a graphing calculator with some short programming. Short 
answers to the examination questions have been listed in Chapter 23 If any 
instructors require solutions to the coursework questions, then they can email me 
directly. I still use these questions with my current students. 

Note that the numbers given in square brackets denote the marks available 
for each part question. 


22.1 Examples of Coursework Questions 


1. A very simple model of the spread of a mobile phone virus (such as 
Commwarrior-A) via Multimedia Messaging Services (MMS) and Bluetooth is 


represented by the smart phone state conversion schematic shown in Figure 22.1. 
We divide the phone modes into SEIRD states and ten kinds of state conversions. 
Among them: S > I, I > D, and D > [are related to Bluetooth spread mode; S 
> E, E > S,and E > Rare related to MMS spread mode; and S > R,I > R, E 
> I, and I > S are owned in common by Bluetooth and MMS two way. 


fs 


n fa 
m 3 


Figure 22.1 Smart phone state conversions. A Susceptible-Exposed-Infected-Recovered-Dormant 
(SEIRD) model for MMS and Bluetooth mixed virus spread. 


(i) Assuming a simple linear model of the state vector x = [S, E, I, R, D], 
where f ; represent forward state conversions and r ; represent reverse state 
conversions, write down the differential equations that model this system. 

(ii) Given that f , = 0.09, f, = 0.02, f 3 = 0. 01, f 4 = 0. 04, f 5 = 0. 01, f = 0. 
01,f,=0.01,r,=0.01,r,=0.006,r 3 = 0. 01, S(0) = 1000, and E(0) = I(0) = 
D(0) = R(0) = 0, use Python to solve the differential equations and plot the time 
series on one graph for 0 < t < 500. 

(iii) Determine the maximum values of E(t), I(t), and D(t) for 0 < t < 500. 

[25] 

2. The differential equations used to model the motion of the double 
pendulum are given by 


Öö _ —e(2m;+m2) sin 0; -mg sin(01—202) 
1 ~ “TT Gm +m5—m> cos(281-262)) 
-2 sin(6, -6> m6 L46; 2 Li cos(O] -th)) 


Ly (2m, +m -m cos(26| —26)) ? 


f 2 sin (6, = >) (6:°L (m + m) +g (mı + mz) COS Al + b Lom cos (8i = 62)) 
f= Ån S 
i Ly (2m; + mz — m cos (26, — 26>)) 


Use Python to plot phase solutions, @ , against @ 5, for the following 
parameter values: 

(a) . . 
g= 9.8, mı = mM = 1, Li = 5,4 = 1,8: (0) = 0.5, 6, = 1.5, 02 = 0, A> = 0; 


(b) 
B= 9.8, mı = mM? = 1, Li = 6, Lo = 1, 6,(0) = 0.5, 6; = 1.5, 64> = 0, 6> = ()- 


Vary the initial conditions for g, slightly and run the simulations for parts 


(a) and (b) again. Give a physical interpretation of the results. 

[25] 

3. The differential equation used to calculate the precession of the perihelion 
of the planet Mercury using General Relativity is given by: 


(4) | GM 3GM 


a@\r@) no t rO — 


where r(@) is the path of Mercury around the sun (taken to be at the origin), 
M is the mass of the sun, G is the gravitational constant, h is related to the 
angular velocity of Mercury, and c is the speed of light in a vacuum. 

(i) Consider a scaled model in which M = 1, G = 1, h = 1, and c = 8. Use 
Python to solve the differential equation (22.1) given the initial conditions r(0) = 
2/3 and 0) — (). Finally, plot a polar solution of r(@) versus 0, for 0 < 6 < 10r. 


HINT: Solve for L. 
r(@) 


(ii) Using the same set of parameters as in part (i), plot Cartesian plots of r(@) 
against @ and S against 0. HINT: Solve for T 
4 r 


(iii) The perihelion of an orbit is defined to be the point on the orbit where 


Mercury is closest to the sun. In this case, the perihelion rotates about the sun 
and describes a precessing perihelion. The perihelia occur when r(@) is a local 
minimum, and the first perihelion occurs at 0 4 = 0. Use the graph from part (ii) 
to determine the next three perihelia, 6 5 34. Hence, deduce that the amount that 
the perihelion precesses per revolution is approximately 60 = 0 ,,, -0 ; — 27 * 0. 
336 radians per revolution. 

[25] 

4. The Hamiltonian function for a particle of mass m that bounces on a 
springy surface is approximated by 


1 
H(x, p) = Fa + V(x), 


where 


EN x <0 
V(x) = 


mex. x20, 


and x is the position of the particle, p is the momentum of the particle, V (x) 
is the potential energy, and C and g are positive constants. 

(a) Write down the equations of motion for x and p in the cases where x > 0 
and x < 0. 

(b) Given that m = 1, g = 10, C = 2 and E = 10: 

(i) sketch the contour of the Hamiltonian H(x, p) = E; 

(ii) solve the equations of motion for x(t) and p(t) for this trajectory, giving 
expressions for both x < 0 and x = 0, separately; 


Hint: for x > 0, assume x(0) = 0, p(0) = 2 V5: 


(iii) prove that the solution spends a time 7, = —_ in the region x = 0, anda 


time PSH di in the region x < 0. 
[25] 


5. The following five-dimensional system models a dispersive driven Jaynes- 
Cummings model from quantum optics: 


Ay = OX + X3 + 

oo = X4 — QX] 

Xï; = Bx4 + X1X5 

X4 = X2X5 — Bx3 

x5 = —4 (X1X3 H X2X4) : 


Use Python to plot 3-D phase portraits (using x 4, X 2, and x s axes) and the 
corresponding power spectra when: 

(i) €=2,a= 2, BP = 2; 

(ii) € = 2,a=0.1, B = 30. 

Take initial conditions x ,(0) = x 5(0) = x 3(0) = x ,(0) = 0 and x ;(0) = -1. 
Describe the solutions in both cases. 

[25] 

6. Consider the following two-dimensional system: 


x =y 


ý =by-nx-m =y, 


when r = 0. 87, m = -1,n = —1. 127921667, and b = 0. 897258546. 

(i) Determine the critical point(s) and their stability. 

(ii) Given that there are four limit cycles in the region - 2 < x < 2and -2 <y 
< 3, use Python to plot all four limit cycles. 

Hint: Three of the limit cycles are very close to one another. Zoom in near 
the cusp point. 

[25] 

7. Use the Lindstedt-Poincaré technique to determine an O(e °) solution to 
the van der Pol equation: 


given that x(0) = a and (0) = 0. 


[25] 

8. A preloaded two-bar linkage mechanism with joints P, Q, and R, 
preloaded by a stiffness k, is shown in Figure 22.2. A periodic force F = sin(@t) 
is applied at Q, where the two bars are joined by a frictionless pin. The angle 0 
denotes the counterclockwise angle the left bar makes with the horizontal, q 
denotes the distance between P and R, and x is the distance between the joint Q 


and the horizontal dashed line. Then 


x= lsin, q= 2Ilcosé. (22.2) 


Figure 22.2 The preloaded two-bar linkage with a periodic force F acting at the joint Q. As the point Q 
moves vertically up and down, the mass m moves horizontally left and right. 


The equations of dynamics for the preloaded two-bar linkage are given by 


ie 3 ae 
((2ml? + mpar ) sin” O + ZMparl?)O + (2M? + Ziyarl?)O sin 0 cos 0 


[cos 6 
2 


+2cP’@ sin? 6 + 2kl (cos o — cos @) sing = — F, (22.3) 


where A = re 


(i) Rewrite equation (22.3) as a 2-D system of ODEs (let Ae $) and use 


Python to plot the solutions to these differential equations given that the 
parameters used are w = 0. 05 (per second), k = 1 (N/m), m = 1 (kg), c =1 
(Ns/m), m par = 0. 5 (kg), 1 = 1 (m), and F = sin(wt). Taking 8(0) = 0. 8, $(0) = 0, 
plot F, on the x-axis, against the vertical displacement x, on the y-axis, as F 
varies sinusoidally from F = -1 to F = +1. How would you describe this 
solution? 

(ii) Given the same parameters as those used in part (i), use Python to plot F, 
on the x-axis, against the horizontal displacement q, on the y-axis, as F varies 
sinusoidally from F = -1 to F = +1. How would you describe this solution? 

(iii) Use equations (22.2) and (22.3) to prove that 


((m + = Mpar (AP = q’) + Š MparP (AP = qü - BMarl qq 


i p) oe) 1 3 
+e — gY + klg — qo\(4P -= gY = AË - qF, (22.4) 


where q 9 = 2lcos(0 9). 

[50] 

9. In 1991, Tso et al. [1] published a paper on the energy exchange model for 
climate change and urban climatological studies. Since that publication it has 
been shown that by adding 10% green cover to areas with little green, such as 
town centers and high density residential areas, maximum surface temperatures 
in these areas can be kept below 1961-1990 baseline temperatures. 

By linearizing the heat storage surface energy balance model, Tso et al. 
arrive at the following set of simultaneous differential equations for T ș, the 


surface temperature and T ,, the soil temperature: 
The Pre-dawn Model. 0 < t < 4. 


dTs aT 
I = B (bi + boTs + b3T, + b4), ra = B(bsTs + b6T, + b7). 
P C 


The Daytime Model. 4 < t < 20. 


ITs dT 
—* = 5 (ci sin (wB(t = 4)) F bT; F bT; F b4) ; = =B (bsTs F bT; F b7) : 
al f 


The Nightime Model. 20 < t < 24. 


dTs dT 
— =B (bı F bT; + bT; + ba) ; =B (bsTs + bel, + b7) : (22.5) 
C C 

[1] Tso C.P., Chan B.K., and Hashim M.A., Analytical solutions to the near- 
neutral atmospheric surface energy balance with and without heat storage for 
urban climatological studies, American Meteorological Society, 30 4, 413—424, 
1991. 

(a) Solve the pre-dawn model equations (22.5) analytically using Laplace 
transforms. 

(b) Given that, for Greater Manchester, 


bi = —4.1706e — 004; bə = —0.0003453037 152548344; 

b = 0.000048566764726985724; b4 = 0.003747576508219105; 

bs = 0.000050988700564971743; be = —0.000101977401 12994349; 
b- = 0.00101977401 1299435; cı = 0.0035987838128722104; 

w = 5.4542e — 005 and B= 3600; 


and the initial conditions T (0) = 12. 1174, T (0) = 17. 0565, use Python to 
plot the solution curves for T , and T ņ for 0 < t < 24. Determine the maximum of 
T s, and the maximum of T ; over this time interval. 


[50] 
10. Consider the Fitzhugh-Nagumo system defined by: 


X= x(u =- x)(x - 4) - y + IŒ), 


where u, A, €, and 6 are constants and I(t) is an external input. Determine the 
number of limit cycles when p = 1, A = —0. 04, £ = 0.015, 6 = 3, and I(t) = 0, use 
Python to: 

(i) show that the origin is the only critical point; 

(ii) plot the limit cycles and comment on their stability. 

[25] 

11. Consider the Morris-Lecar neuron model defined by: 

cx =l- 8fastMss (V) (V = Eya) 7 LslowN (V z Ex) — Eleak (V T Eiet) 


dt 


aN = Ø (Nss(V) — N) /tN(V), 


dt 


y=e(x-dy), 


v 


where V is membrane potential, N is a recovery variable, I is the applied 
current, C is membrane capacitance, g fast I slow» J leak represent conductances 


through membrane channels, E ya E x, E leag are equilibrium potentials of the 
relevant ion channels, and @ is a constant, and 


Mgs(V) = $(1 + tanh (+), 
V-B, 
Nss(V) = 5 (1 + tanh (£x), 
TAV) = — 
(os x") 
where P mw Ê N: Y m and y y are constants. 
(i) Use Python to show that the system has three limit cycles when I = 82 
MA, g fast = 20 mS/cm?, g slow = 20 MS/cmM?, g jeak = 2 MS/cm?, E ya = 50 mV, E 


K = 7100 mV, E jeak = -70 mV, Ọ = 0.15, B m= -1.2 mV, B y=-20.5mV,y, 
= 18 mV, y y= 10 mV, and C = 2 pF/cm?. Comment on the stability of each limit 
cycle. 

(ii) Use Python to produce an animation for the Morris-Lecar model using 
the same parameters listed in part (i) as the input current J increases from I = 75 
mA to I= 85 mA. Taking initial values of V ọ = -40 mV and N ọ = 0. 1 mV, how 
would you describe the bifurcations that occur? Take snapshots of the animation 
to include in your submitted work. 

[50] 

12. Consider the following map: 


Xn+1 = Ea + Yn + U COS (27Yn)) mod I Yn+1 = (Xn T 2Yn) mod 1. 


(a) Given that u = 0. 1 with initial conditions x 9 = 0.1, y ọ = 0.1, plot the 
first 10,000 iterates, ignoring the first 100. What can you deduce about the orbit? 
(b) Determine the number of fixed points of period one when p = 0. 5, and 

determine the stability of the fixed point at (0. 5, 0. 5). 
(c) Suppose that u = 0.5 and d ọ = 107$. Let x(n) = (xn, Yn) be the n’th 


iterate of the initial point x(0) = (0.5 + do, 0.5). Furthermore, let 


=05) 46,.-05Y 


d(n) = N (Xn 


be the distance of x(n) from the initial point. Given that 


an 


Fon) = 7n( 


compute F(4), F(20), and F(100). What is the relationship between these 
values of F(n) and the magnitude of the largest value of the Jacobian matrix for 
the fixed point (0. 5, 0. 5)? 

[25] 

13. Consider the following 2-dimensional mapping: 


= a 2 
Ant] = Ay Yn + A,X, + A2Yn, (22 6) 


2XnYn + 3X), + d4Yn- 


Yn+l 


(a) Given that a , =0.9,a5=~-0.6,a3=2, and a 4 = 0. 5: 
(i) determine the fixed points of period one for system (22.6) and determine 


their stability; 
(ii) obtain an iterative plot given that x ọ = y ọ = 0. 1 explain the results; 


(iii) suppose that d ọ = 101°, and let x(n) = (xn, Yn) be the n’th iterate of the 
point x(0) = (0, do). Let 


d(n) = 4| x} + y2 


be the distance of x(n) from the fixed point (0, 0) and 


= 1 fda) 
Poemi n-m a (=| 


Use Python to compute F(4, 1), F(20, 4), and F(100, 20). Comment on the 
relationship between these values of F(n, m) and the magnitude of the largest 
eigenvalue of the Jacobian matrix for the fixed point (0, 0). 

(b) Try to obtain iterative plots in the cases: 

(i)a,=0.5,a,=-0.5,a3=2, anda ,=0.3, given x(0) = y(0) = 0. 1 
explain the results; 

(i)a; =0.9,a = -0. 6,a 3 = 2, anda, = 0. 8, given x(0) = y(0) = 0.1 
explain the results. 

[25] 

14. A simple model of a two-neuron module with one self-interaction is 
described by the difference equations 


Xn+1 = bi + w11 tanh (ax,) + w12 tanh (byn), = Vas = ba + wa; tanh (ax,) 


where x „Y , are the activation levels of neurons x and y, b 4, b 5 are biases, 
w 11 is a self-weight, and w 13, w >, are weights of synaptic connections 
(Figure 22.3). 


Figure 22.3 A two-neuron module. 


(a) Given that a = 1, b = 0. 3, b > = -3, w 41 = 72, w 12 =~-1, and w 5, = 5, use 
Python to determine the number, location, and stability of the fixed points of 
period one when: (i) b į = —4 and (ii) b į = -2. 

(b) Using the same parameter values listed in part (a), edit the relevant 
Python program from the notes to plot bifurcation diagrams for - 5 < b į < 5, 


and give a physical interpretation of the results. 
[25] 
15. The Tinkerbell map is given by: 


2 2 3 
Xn+1 = Xa — Vy t AX, + bYn, Yn+1 = 2XnYn + CXn + dyn, (22.7) 


where a, b, c, and d are all constants. 

(a) Suppose that b = —-0. 5, c = 2. 3, and d = 0.5 in system (22.7). Use Python 
to obtain iterative plots when: (i) a = 0. 2; (ii) a = 0. 4; (iii) a = 0. 6; (iv) a = 0. 8; 
(v) a = 1. Describe the behavior of the system (22.7) for each value of a listed 
above. 

(b) Using the same parameter values listed in part (a), plot a bifurcation 
diagram for system (22.7) forO<a< 1. 

[25] 

16. Use Python to plot a Newton fractal for the function f(z) = (z ? + 1)(z ? - 
5. 29). If you have plotted the correct figure, you will notice that there are 
regions in which the Newton method failed to converge to one of the roots. How 


would you explain this phenomenon? 

[25] 

17. Consider the weight distribution motif displayed in Figure 22.4. How 
will the weight be distributed at stage 2 of the construction of the multifractal? 


Figure 22.4 Motif of a multifractal . 


Given that: 


_n(az, pf) 
T(q) = en 7 


and 
f(a(q)) = qalq) + T(q), 


use Python to plot an f(a) curve for the multifractal generated by the weight 
distribution motif given in Figure 22.4. 

[25] 

18. Using the housing.txt data presented in Chapter 20, reproduce 
Figure 20.8 showing the number of epochs versus the mean squared error for the 
complete Boston housing data when (i) one neuron, and (ii) two neurons are in 
the hidden layer . 

[25] 

19. Using the results of the Destexhe et al. paper referenced in Section 21.1 
reproduce figures 21.4(a) and (b) using the Hodgkin-Huxley equations, 
illustrating excitation and inhibition. 

[25] 


20. The MATLAB code below computes the Lyapunov exponents of the 
Lorenz system . Convert this code into Python. 


% Taken from my MATLAB book. 

% Programs 14d - Lyapunov exponents of the Lorenz s 
ystem. 

% Chapter 14 - Three- 
Dimensional Autonomous Systems and Chaos. 

% Copyright Springer 2014. Stephen Lynch. 


% Special thanks to Vasiliy Govorukhin for allowing 
me to use his 

% M- 
files. For continuous and discrete systems see the Lya 
punov 

% Exponents Toolbox of Steve Siu at the Mathworks f 
ile exchange. 


% Reference. 

% A. Wolf, J. B. Swift, H. L. Swinney, and J. A. Va 
stano, 

% "Determining Lyapunov Exponents from a Time Serie 
s," Physica D, 

% Vol. 16, pp. 285--317, 1985. 

% You must read the above paper to understand how t 
he program works. 


% Lyapunov exponents for the Lorenz system below ar 
e: 
% L_1 = 0.9022, L_2 = 0.0003, L_3 = -14.5691 when t 
end=10, 000. 


function [Texp, Lexp]=lyapunov(n,rhs_ext_fcn,fcn_int 
egrator,tstart,... 
stept, tend, ystart,ioutp); 


n=3;rhs_ext_fcn=@lorenz_ext; fcn_integrator=@ode45; 
tstart=0;stept=0.5; tend=300; 
ystart=[1 1 1];10utp=10; 


ni=n; n2=n1*(n1+1); 


% Number of steps. 
nit = round((tend-tstart)/stept); 


% Memory allocation. 
y=zeros(n2,1); cum=zeros(n1,1); yO=y; 
gsc=cum; znorm=cum; 


% Initial values. 
y(i:n)=ystart(:); 


for 1=1:n1 y((ni+1)*1i)=1.0; end; 
t=tstart; 


% Main loop. 
for ITERLYAP=1:nit 
% Solutuion of extended ODE system. 
[T,Y] = feval(fcn_integrator,rhs_ext_fcn, 
[t ttstept],y); 
t=ttstept; 
y=Y(size(Y,1),:); 


for i=1:n1 
for j=1:n1 yO(n1*1it+j)=y(n1*j+i); end; 
end; 
% Construct new orthonormal basis by Gram-Schmidt. 


Znorm(1)=0.0; 
for j=1:n1 znorm(1)=Znorm(1)+y0(n1*j+1)42; end; 


Znorm(1)=sqrt(znorm(1)); 
for j=1:n1 yO(n1*j+1)=yO(n1*j+1)/znorm(1); end; 
for j=2:n1 


for k=1:(j-1) 
gsc(k)=0.0; 


for 1l=1:n1 gsc(k)=gsc(k)+y0(n1i*1+j)*yoO(n1 
*1+k); end; 
end; 


for k=1:n1 
for 1=1:(j-1) 
yO(ni*k+j )=y0(n1*k+j) - 
gsc(1)*yO(n1*k+1); 
end; 
end; 


znorm(j)=0.0; 
for k=1:n1 znorm(j)=Znorm(j)+yO(n1*k+j)42; en 


znorm(j)=sqrt(znorm(j)); 
for k=1:n1 yO(n1*k+j )=yO(n1*k+j)/znorm(j); en 
end; 
% Update running vector magnitudes. 
for k=1:n1 cum(k)=cum(k)+log(znorm(k)); end; 
% Normalize exponent. 
for k=1:n1 
lp(k)=cum(k)/(t-tstart); 
end; 
% Output modification. 
if ITERLYAP==1 
Lexp=1p; 
Texp=t; 
else 
Lexp=[Lexp; lp]; 


Texp=[Texp; t]; 
end; 


for i=1:n1 
for j=1:n1 
y(ni*j+i)=yo(n1*1i+j); 


% Show the Lyapunov exponent values on the graph. 

stri=num2str(Lexp(nit,1));str2=num2str(Lexp(nit, 2) ) 
,str3=num2str 

(Lexp(nit,3)); 

plot(Texp,Lexp); 

title(’Dynamics of Lyapunov Exponents’ ); 

text(235,1.5, ’\lambda_1=’, ’Fontsize’,10); 

text(250,1.5,str1); 

text(235, -1, ’\lambda_2=’, ’Fontsize’,10); 

text(250,-1,str2); 

text (235, -13.8, ’\lambda_3=’, ’Fontsize’,10); 

text(250, -13.8,str3); 

Xlabel(’Time’); ylabel(’Lyapunov Exponents’ ); 

% End of plot 


function f=lorenz_ext(t,X); 
% 


% Values of parameters. 
SIGMA = 10; R = 28; BETA = 8/3; 


X=X(1); y=X(2); Z=X(3); 

Y= [X(4), X(7), X(10); 
X(5), X(8), X(11); 
X(6), X(9), X(12)]; 

f=zeros(9,1); 

%LOrenz equation. 


f (1)=SIGMA*(y-x); 


CIAN E i 


T(Z)=-X*Z+RK*X-Y; 
f(3)=x*y-BETA*z; 


%Linearized system. 


Jac=[-SIGMA, SIGMA, 0; 
R-Z, -1, -X; 
Y, X, -BETA] 


%Variational equation. 
f(4:12)=Jac*Y; 


%0utput data must be a column vector. 
% End of Programs 14d. 


[50] 


22.2 Examination 1 

Typically, students would be required to answer five out of 8 questions in three 
hours. The examination would take place in a computer laboratory with access to 
Python. 


1. 
a) 
Sketch a phase portrait for the following system showing all nullclines: 
dx dy 
SSO 2. ay, 
di ” d i 
[8] 
(b) 
Show that the system 
dx 2 3 W 9 3 2 
— = yxy- x yty, — =y +x —xy 
ai J yer oF y y 


can be transformed into 


dr do 
— =; sin(@), P7 =; (cos(@) — sin(@)) (cos(@) + sin(@)) 
C 


2. 


3; 


(a) 


(b) 


(a) 


using the relations rż = xx + yy and ;?ġ = yý — yx. Sketch a phase 


portrait for this system given that there is one nonhyperbolic critical 
point at the origin. 
[12] 


Prove that the origin of the system 


dx xX dy 
EE Sa 
E | a ies 


is asymptotically stable using the Lyapunov function V = x °? + 2y 2. 


[6] 


Solve the differential equations 
dr > dO | 


ae r 5 eo l, 
dt dt 
given that r(0) = 1 and 8(0) = 0. Hence show that the return map , say, 
P, mapping points, say, r „ on the positive x-axis to itself is given by 
Fn 
Fn =P Fn Se 
E aay, 


[14] 


Find the eigenvalues of the following system and sketch a phase 
portrait in three-dimensional space 


dx 5 dy dz 

SSL SZ = > Sy, E 

di a ae. 
[12] 

Show that the origin of the following nonlinear system is not 

hyperbolic: 


dx dy 3 E 


Prove that the origin is asymptotically stable using the Lyapunov 
function V = x? + 2y ? + z ?. What does asymptotic stability imply for a 
trajectory y(t) close to the origin? 


[8] 
(a) 


Consider the 2-dimensional system 
dr 3 dé 
SST rist |. —=]=1 
parrot la = 
Show how the phase portrait changes as the parameter p varies and 
draw a bifurcation diagram. 
[10] 
b) a 
Prove that none of the following systems has a limit cycle: 
0) lx 3 ly das 
Tyer a Aayar y 
(ii) 
ax — y — 2xy -+ y; a = x2 + y? + ay? 
(iii) 
dx 


= 2 dy _ 2 Di 
Fay ae ae ey 


] 


[10] 


5. a) 


Let T be the function T: [0, 1] > [0, 1] defined by 


5 
KA 0 < <= 
T(x) = PERS ewe: 
4 7 
Determine the fixed points of periods one, two, and three. 
[12] 
(b) 


Determine the fixed points of periods one and two for the complex 
mapping 


2 
nil = Ln A 


Ta 


' (a) 


(b) 


(a) 


(b) 


Determine the stability of the fixed points of period one. 


[8] 


Starting with an equilateral triangle (each side of length 1 unit) 
construct the inverted Koch snowflake up to stage two on graph paper. 
At each stage, each segment is i the length of the previous segment, 


and each segment is replaced by four segments. Determine the area 
bounded by the true fractal and the fractal dimension. 
[14] 


Prove that 


N 
_, Di In Di 
D, = lim dit Pila(p) prad ) 
30 —In() 
by applying L’Hopital’s rule to the equation 
i nye, pid 
m —— ———_—_—_—_. 


D, = li 
e l-q -Inl 


[6] 


Find and classify the fixed points of period one of the Hénon map 
defined by 


9 2 
Xn+1 = l- =X, Yn Yn+l = Zn. 


5 5 
[8] 
Consider the complex iterative equation 
E,+| = A + BE, exp (i JEN): 


Derive the inverse map and show that 


d|A|? 
d|Es|° 


= 1 + B’ + 2B(\Es/ sin |Es}? - cos|Es|’), 


where E sis a steady-state solution. 
[12] 


8. (a) 


A four-neuron discrete Hopfield network is required to store the 
following fundamental memories: 


x, =(1,1,1,1)’, x» =(1,-1,1,-1’ x3 =(1,-1,-1,1)'. 


(i) 
Compute the synaptic weight matrix W. 
(ii) 
Use asynchronous updating to show that the three fundamental 
memories are stable. 
(iii) 
Test the vector (-1, -1, —1, 1)" on the Hopfield network. 
Use your own set of random orders in (ii) and (iii). 
[10] 
Oia, & , | | 
Derive a suitable Lyapunov function for the recurrent Hopfield 
network modeled using the differential equations 


[10] 


22.3 Examination 2 


Typically, students would be required to answer five out of 8 questions in three 
hours. The examination would take place in a computer laboratory with access to 
Python. 


1. (a) 


(b) 


(a) 


(b) 


The radioactive decay of Polonium-218 to Bismuth-214 is given by 


218Po => 214Ph => ASBI, 


where the first reaction rate is k 4 = 0. 5 s 7t, and the second reaction 
rate is k» = 0.06s “t. 


(i) 
Write down the differential equations representing this system. 
Solve the ODEs. 
(ii) 
Determine the amount of each substance after 20 seconds given 
that the initial amount of*!®Po was one unit. Assume that the 
initial amounts of the other two substances was zero. 
(iii) 
Plot solution curves against time for each substance. 
(iv) 
Plot a trajectory in three-dimensional space. 
[14] 


Plot the limit cycle of the system 


d dy 
— = y + 0.5x(1 -0.5-3° -y’), = aae = 5), 


Find the approximate period of this limit cycle. 


[6] 


Two solutes X and Y are mixed in a beaker. Their respective 
concentrations x(t) and y(t) satisfy the following differential equations: 
dx > dy r 2 

— =X- xy- ux, SE Vt Ky Hy. 
di YH P7 YTY- 
Find and classify the critical points for u > 0, and plot possible phase 
portraits showing the different types of qualitative behavior. Interpret 
the results in terms of the concentrations of solutes X and Y. 

[14] 


Determine the Hamiltonian of the system 
dx dy 2 
—=y, —=x- i 
dt dt 


Plot a phase portrait. 


[6] 
3. 
(a) 
For the system 
dx 3 dy 
— = ux+ x, —=- 
d A di 
sketch phase portraits for u < 0, u = 0, and p > 0. Plot a bifurcation 
diagram. 
[10] 

(b) l av aes l 
Plot a phase portrait and Poincaré section for the forced Duffing 
system 

dx dy 3 
— =y, —=x-0.3y-x + 0.39 cos(1.25t). 
eR orn y-x s(1.25¢) 
Describe the behavior of the system. 
[10] 
4. a) 
Given that f(x) = 3. 5x(1 - x), 
(1) 2 3 4 
plot the graphs of f(x), f (x), f°(x), and f“(x); 
(ii) 
approximate the fixed points of periods one, two, three, and four, 
if they exist; 
(iii) 
determine the stability of each point computed in part (ii). 
[12] 
(b) 


Use Python to approximate the fixed points of periods one and two for 
the complex mapping Z „+4 =Z p? +2 + 3i. 


(a) 


(b) 


(a) 


(b) 


(a) 


(b) 


" (a) 


[8] 


Find and classify the fixed points of period one for the Hénon map 
2 
Xn+1 = 1.5 + 0.2y, — Xn Yn+1 = Xn. 


Find the approximate location of fixed points of period two if they 
exist. Plot a chaotic attractor using suitable initial conditions. 
[14] 


Using the derivative method, compute the Lyapunov exponent of the 
logistic map xX „+1 = HX „(1 - X ,), when p = 3.9. 


[6] 


Edit the given program for plotting a bifurcation diagram for the 
logistic map to plot a bifurcation diagram for the tent map. (Students 
would have access to the Python program listed in Chapter 14). 

[10] 


Write a program to plot a Julia set J(0, 1. 3), for the mapping Z „+1 =Z pn 


244.37. 
[10] 


Given the complex mapping £ -A+B E, g'lEn? , determine the 


n+ 
number and approximate location of fixed points of period one when A 
= 3.2 and B=0.3. 

[10] 


Write a Python program for producing a triangular Koch curve, where 
at each stage one segment is replaced by four segments and the scaling 
factor is i. 


[10] 


A six-neuron discrete Hopfield network is required to store the 


C 11l s - C 1 


TOLLOWINg Tundamental Memories: 


tee GOs Ol OS A © ta 
eee eed eae Devens a 
ees, bias. 


(i) 
Compute the synaptic weight matrix W. 
(ii) 
Use asynchronous updating to show that the three fundamental 
memories are stable. 
(iii) 
Test the vector (-1, -1, -1, 1, 1, 1) on the Hopfield network. 
Use your own set of random orders in (ii) and (iii). 
[10] 
b) 
Given that 


. Slap; +(k—'s)In po f= In H) 
r= ~kin3 Ss 


write a short Python program to plot the f(a) spectrum for the 
multifractal Cantor set constructed by removing the middle third 
segment at each stage and distributing the weight in the proportions 
Pix i and p = £. Sketch the f(a) curve and write down the Python 


code in your answer booklet. What information does the width of the 
curve give? 
[10] 


22.4 Examination 3 


Typically, students would be required to answer five out of 8 questions in three 
hours. The examination would take place in a computer laboratory with access to 


Nk than 


rY y Wull. 


1 
' (a) 
Sketch a phase portrait for the following system showing all nullclines: 
dx dy 
— =+ 3y = = a2 y 
dt dt 
[8] 
(b 
Solve the differential equations 
dr > dé 
ee eae SAP cg = = de 
dt dt 
given that r(0) = 2 and @(0) = 0. Hence determine the Poincaré return 
map mapping points, say, r „ on the positive x-axis to itself. 
[12] 
2. (a) 
Plot phase portraits and a bifurcation diagram for the system 
dx ) 
-E -= yy- u+ 1). 
r TORD 
[14] 
Plot a bifurcation diagram for the system 
dr dé 
— =r(u+r), —=-l. 
d TP 
[6] 
3 


a 


An interacting species model of the Balsan fir tree, moose, and wolf at 
the Isle Royale National Park USA is given by 

db dm dw 

— = b(1 - b) - bm, — = m(1 — m) + bm - mw, — = w(1 - w) + mw, 
dt l ) dt l ) dt l ) 
where b(t) represents the population of Balsan fir trees, m(t) is the 
population of moose, and w(t) gives the population of wolves at time t. 
Determine the number and location of all critical points and show that 


4. 


5. 


(b) 


(a) 


(b) 


(a) 


(b) 


there is a stable critical point for b(t), m(t), w(t) > 0. 
[12] 


Find the fixed points of periods one and two for the complex mapping: 
Zm =l +i 


[8] 


Consider the mathematical model of glycolysis: 
ce ex Oly sary. Y=]05-0.1ye wy, 


where x and y represent the concentrations of ADP (adenosine 
diphosphate) and F6P (fructose 6-phosphate), respectively. Plot the 
nullclines given by (x = ý = 0) and show where the flow is vertical 


and horizontal. Given that there is a critical point in the first quadrant 
at (0. 5, 1. 4286),show that it is unstable. 
[10] 


Show that there is an annular region which is positively invariant by 
considering the critical point from part (a) and the flow along the lines: 


Li:y=5,0< x< Oo: 

L: x= 5.4,0<y<0.l; 
Lz:x=0,0<y< 5; 

La :y=0,0 < x< 5.4; 

Ls : y = =x + 5.5,0.5 < x < 5.4. 


What can you deduce from these results and the results in part (a)? 
[10] 


Derive the inverse of the complex Ikeda mapping 


, C 
E1 =A+ BE, exp { (0 = ail ; 


[8] 


Ts 


(a) 


(b) 


(a) 


A highly simplified model for the Gross National Product (GNP) of a 
country is given by the iterative equation 


BK? (1 _ ky 


km1 = f(k) =0.5 12 


Plot the curves for f(k) when B = 1 and B = 4. Use Python to plot the 


corresponding curves for 4f. Show that there is a stable fixed point of 
dk 


period one when B = 1 and an unstable fixed point of period one when 
B = 4. What happens when B is approximately 3. 26? 
[12] 


Find the fixed points of periods one and two for the Lozi map 


Xn+1 = l+ Yn 7 pAb aa Yn+1 = yn 


and classify the fixed points of period one. 
[10] 


Consider the map defined by x,,,; = f (x,), where f(x) is defined by 


Plot the function on graph paper. Consider the sets, S „ say, which 
remain in the interval [0, 1] after n iterations. List the intervals in S 4 
and S 5. The set of points that never escape from the interval [0, 1] 


form a Cantor set. What is the fractal dimension of this Cantor set? 
[10] 


A certain species of insect can be divided into three age classes: 0—6 
months, 6-12 months, and 12—18 months. A Leslie matrix for the 
female population is given by 


8. 


(b) 


(a) 


(b) 


10 2 
0 
1 
3 


© 


L= 


Ovni © 


0 
0 


Determine the long-term distribution of the insect population . An 
insecticide is applied which kills off 50% of the youngest age class. 
Determine the long-term distribution if the insecticide is applied every 


six months. 
[10] 


Consider the Ikeda map given by: 
Eni = 10 + 0.15E, exp (iEn), 


where E „is the electric field strength of propagating light in an 
SFR resonator (see Chapter 5). Using Python and taking E(1) = 10, 
iterate 10000 times and plot a power spectrum for | E „ |?. Write down 


the Python program in your answer booklet. 
[10] 


The Lyapunov exponent, say A, for the map 
Xn+1 = T (Xn) 
is defined by 


n-1 
1 
A= lim|- ) In|f’ (x) |]. 
in: > mI | 
i=0 
Use Python to compute the Lyapunov exponent of the sine map 


Xn+1 = r sin (Xn) 3 


for 0 < x „ < 1, when r = 1. 3 and x ọ = 0. 1. Write down the value of 


the Lyapunov exponent and the Python code in your answer booklet. 
What type of solution is defined by (i) A < 0, (ii) A = 0, and (iii) A > 0? 
[10] 


Motifs for the Koch curve and Lévy curve are shown in Figure 22.5 


and a Python program for plotting the Koch curve up to stage 7 is 
listed below. Edit this program (copy your program in to the answer 
booklet) to plot the Lévy curve up to stage 7. 


Koch motif Lévy motif 


Figure 22.5 Motifs for the Koch curve and Lévy curves. 


# The Koch curve up to stage 7. 
import numpy as np 

import matplotlib.pyplot as plt 
from math import floor 


=6;N_lines=4**k;h=3**(-k); 
[0]*(N_Lines+1) 
[0]*(N_Lines+1) 

[0] = 0;y[0] = 0; 


segment=[0]*N_lines; 


k=6 
x= 
y = 
x| 0 


# The angles of the four segments. 
angle=[0,np.pi/3, -np.pi/3,0] 
for 1 in range(N_lines): 
m=1;ang=0; 
for j in range(k): 
segment [j ]=np.mod(m, 4) 
m=floor(m/4) 
ang=angtangle[segment[j] ] 


X[i+1]=x[i]+h*np.cos(ang) 
y[iti]=y[i]+h*np.sin(ang) 


plt.axis(’equal’ ) 
plt.plot(x,v) 
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23. Solutions to Exercises 


Stephen Lynch! 


(1) Manchester Metropolitan University, Manchester, UK 


23.1 Chapter 1 
F 
(a) 


# A function to convert degrees Fahrenheit to dec 
Centigrade. 

# Save file as F2C.py. 

# Run the Module (or type F5). 

def F2C(): 
F = int(input(’Enter temperature in degrees Fat 
C = (F - 32) *5/9 
print(’Temperature in degrees Centigrade is: { 

C’.format(C) ) 


(b) 


# Sum of primes to n. 
# Save file as Sum_primes.py. 


n = int(input(’wWhat do you want to sum to? ’)) 
sum_p = 0 
for n in range(2, n+1): 
if all(n % i for i in range(2, n)): 
sum_p += n 
print(’The sum of the first {:,} primes is {:,}’. 
sum_p) ) 


# Part solution to Pythagorean triples. 
# Save file as pythag_triples.py. 

n=1 

m = 100 

f 


Or a in range(1, m): 
for b in range(1, m): 
if a**2 + b**2 == (b+n)**2: 
print(a, b, b+n) 


(d) 
# Plot the Koch snowflake. 


# Save file as koch_snowflake.py. 


from turtle import * 
def koch_snowflake(length, level): # KochSnowflé 
speed(0) # Fastest speec 
for i in range(3): 
plot_side(length, level) 
rt(120) 


def plot_side(length, level): # Plot side func 

if level==0: 

fd( length) 

return 
plot_side(length/3, level - 1) 
1t(60) 
plot_side(length/3, level - 1) 
1t(-120) 
plot_side(length/3, level - 1) 
1t (60) 
plot_side(length/3, level - 1) 


# Plot the Sierpinski square. 
# Save file as sierpinski_Square.py. 


from turtle import * 


def sierpinski_square(length, level): 
speed(0) # Fastest speed 
if level==0: 
return 
begin_fill() # Fill shape 
color("red") 


for 1 in range(4): 
sierpinski_square(length/3, level-1) 
fd(length/2) 
sierpinski_square(length/3, level-1) 
fd(length/1) 
1t(90) # Left turn 90 degrees 
end_fill() 


a) 
3; (b) 531441; (c) 0.3090; (d) 151; (e) -5 


(a) 
57 38 19 
A+4BC =| 40 25 16 
35 19 14 
b 
(0) 0.4 —0.6 0.2 0 1 -1 
A'=!] 0 1 OB St 2 -2 -1 
—0.6 1.4 0.2 -1 1 J] 
The matrix C is singular. 
(c) 
—-]1 4 —4 
A =| 0 1 0 
12 20 -7 
(d) l 
Determinant of C = 0. 
(e) 


Eigenvalues and corresponding eigenvectors are 
À , = —0. 3772, (0. 4429, —0. 8264, 0. 3477)'; 


A» = 0. 7261, (0. 7139, 0. 5508, -0. 4324)°; 
À > = 3. 6511, (0. 7763, 0. 5392, 0. 3266)!. 


a) 
— 1 + 3i; (b) 1 — 3i; (c) 1. 4687 + 2. 2874i; (d) 0. 3466 + 0. 7854i; (e) — 1. 


) 
1; (b) 4; (c) 0; (d) œ%; (e) 0. 


9x * + 4x; (b) _2x3_; (c) e *(sin(x)cos(x) + cos*(x) — sin?(x)); (d) 1 — tanh 
Viex4 


(1) 
-#; (8) 1; (h) yr; @ 2; G) divergent. 


7. 
See Section 1.2.2. 
8. (a) 
y(x) = ENV +2? ©) yx) = $ (O) yey) = Utent; (a) xC) = -2e 
Bet — Be _ J cost + + sint- 
9. 
(a) When x(0)=0.2, (b) when x(0)=0.2001, 
xX(91)=0.8779563852 X(91)=0.6932414820 
X(92)=0.4285958836 X(92)=0.8506309185 
X(93)=0.9796058084 X(93)=0.5082318360 
x(94)=0.7991307420e-1 xX(94)=0.9997289475 
x(95)=0.2941078991 x(95)=0.1083916122e-2 
X(96)=0.8304337709 X(96)=0.4330964991e-2 
X(97)=0.5632540923 X(97)=0.1724883093e-1 
X(98)=0.9839956791 X(98)=0.6780523505e-1 
xX(99)=0.6299273044e-1 xX(99)=0.2528307406 
X (100 )=0.2360985855 X(100)=0. 7556294285 
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Euclid’s algorithm, greatest common divisor. 


# Euclid’s algorithm to find the gcd. 
# See Exercise 10. 
# Run the Module (or type F5). 


a = 12348 

b = 14238 

while b != 0: 
d=a%b 
a=b 


b=d 


print(’The greatest common divisor is {}’.format( 


The greatest common divisor is 126 


23.2 Chapter 2 


1 
' (a) 
y= £; (b) y = Cx 7 (c) y= Cy% (d) 1 = n(£) (e) Ś + =e Z C 
(f) y = Cae 
2. 
The fossil is 8. 03 x 10° years old. 
3. 
(a) | 
d = kp(ao — d)(bo — d)(co — d) — k,(do + d): 
(b) 
ž = kp(ag - 3x)? — k,x» where a = [A], x = [A 3], b = [B], c = [C], and 
d = [D]. 
4. 
(a) l 
The current is J = 0. 733 amps; 
(b) | 
the charge is Q(t) = 50(1 — exp(-—10t - t 4)) coulombs. 
5. 
(a) Time 1.18 hours. (b) The concentration of glucose is 
G 
ie ~Ce™, 
8) = Too“ 
6. 
Setx()=>),-9° a,t” 
7. 


The differential equations are 


A=-aA, B= œA - BB, C = BB. 


The differential equations are 


H = -aH + bl, l=aH-(b+o)I, D=cl. 
The number of dead is given by 
a — B + Be“ — ae” 
apla — p) l 


where a and f are the roots of A* + (a + b + c)À + ac = 0. This is not realistic 
as the whole population eventually dies. In reality people recover and some 
are immune. 


D(t) = acN 


a) 
(i) Solution is x 7 = 1(1 - 3t), with maximal interval (MI) -o < + < 4 
; (ii) x(0) = (e £ + 33 - e 9, with MI —œ < t < In3; (iii) x(t) = 3 - e 
*), with MI —o0 < ¢ < In V3- 

(b 


Solution is x(t) = (t + x 9 7 - t 0), with MI tgo- Xo 2 <t< œ. 


23.3 Chapter 3 


1. 


(a) 


(b) 


(a) 


(b) 


(c) 


(d) 


(e) 


(f) 


(a) 


(b 


Eigenvalues and eigenvectors are A , = —10, (2, 1)';A > = -3, 
(3, 1)’. The origin is a stable node. 


Eigenvalues and eigenvectors are A , = —4, (1, 0)!; A 7 = 2, (-%, 1). 


The origin is a saddle point. 


All trajectories are vertical and there are an infinite number of critical 


points on the line y = —S. 


All trajectories are horizontal and there are an infinite number of 


critical points on the line y = —=. 


Eigenvalues and eigenvectors are A 4 = 5, (2, 1)"; A > =-5, (1, —2)!, 
The origin is a saddle point. 


Eigenvalues are A 4 = 3 + i, A = 3 — i, and the origin is an unstable 
focus. 


There are two repeated eigenvalues and one linearly independent 
eigenvector: A , = —1, (-1, 1)". The origin is a stable degenerate node. 


This is a nonsimple fixed point. There are an infinite number of 
critical points on the line y = x. 


X=y, ý = -25x - py; 


(i) unstable focus, (ii) center, (iii) stable focus, (iv) stable node; 


W (i) oscillations grow (not physically possible), (ii) periodic 


oscillations, (iii) damping, (iv) critical damping. 


4. 


The constant p is called the damping coefficient. 


(a) 
There is one critical point at the origin which is a col. Plot the 
nullclines. The eigenvalues are } _ -1+v5 with eigenvectors / | 
to 
| Ai | 
and / 1 \. 
| Ay | 
(b) 


There are two critical points at A = (0, 2) and B = (1, 0). A is a stable 
focus and B is a col with eigenvalues and corresponding eigenvectors 


given by 1 \ and ioe 
aao) ali] 


(c) 
There are two critical points at A = (1, 1) and B = (1, -1). Ais an 
unstable focus and B is a stable focus. Plot the nullclines where 


x=Oand y=0. 


(d) 
There are three critical points at A = (2, 0), B = (1, 1), and C = (1, -1); 
A is a col and B and C are both stable foci. 

(e) 
There is one nonhyperbolic critical point at the origin. The solution 
curves are given by y? =x? + C. The line y = x is invariant, the flow 
is horizontal on y = x? = 0, and the flow is vertical on the line 


x = y? = (0). The slope of the trajectories is given by ¢y _ x : 
7 dx y 


(f) 
There is one nonhyperbolic critical point at the origin. The solution 
X 


curves are given by y = co The line y = x is invariant. 


There is one nonhyperbolic critical point at the origin. The solution 
curves are given by 2y ? = x 4 + C. The slope of the orbits is given by 


(h) 


When p < 0 there are no critical points. When p = 0, the solution 
curves are given by pis Ger When p > 0, there are two critical 


points at A = (0, jz) and B = (0, — ju); A is a col and B is an 


unstable node. 


One possible system is 
gay x, yexrsty-2, 
for example. 


There are three critical points at O = (0, 0), A = (1, 0), and B = (-1, 0). If a ọ 
> 0, since det J ọ > 0 and trace J ọ < 0, the origin is stable and A and B are 
cols because det J < 0 for these points. If a ọ < 0, the origin is unstable and 
A and B are still cols. Therefore, if a 9 > 0, the current in the circuit 
eventually dies away to zero with increasing time. If a ọ < 0, the current 
increases indefinitely, which is physically impossible. 


There are three critical points at O = (0,0), A = (£, 0), and 


b? 


B= ( c+a dao), The origin is an unstable node and A is a col. The critical 
bee 2b 


point at B is stable since det J g > 0 and trace J g < 0. Therefore, the 
population and birth rate stabilize to the values given by B in the long term. 


When of > 1, there is one stable critical point at 4 = (0, a When aß < 1, 


A becomes a col and g — (/1 — of, a) and ÇC = {= yl — of, q) are 


both stable. When af > 1, the power goes to zero and the velocity of the 
wheel tends to 3 and when af < 1, the power and velocity stabilize to the 


point B. 


(a) 
There is one critical point at ( KGo Co ) which is in the first 
K-C° K-C 
quadrant if K > C. When C = 1, the critical point is nonhyberbolic. 
The system can be solved and there are closed trajectories around the 
critical point. The economy oscillates (as long as I(t), S(t) > 0). If C # 
1, then the critical point is unstable if 0 < C < 1 and stable if C > 1. 
(b) 
The critical point is stable and the trajectory tends to this point. The 
choice of initial condition is important to avoid I(t) or S(t) from going 
negative, where the model is no longer valid. 
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Note that 41 — ot and ay _ dn at. There are four critical points: O = (0, 
dt dr? dr dt 


0), an unstable node; A = (~1, 0), a col; B = (0, 2), a col; and ç = (-: +) 


3 
2 


a stable focus. 


23.4 Chapter 4 


1. 


This is a competing species model. There are four critical points in the first 
quadrant at O = (0, 0), P = (0, 3), Q = (2, 0), and R = (1, 1). The point O is 
an unstable node, P and Q are both stable nodes, and R is a saddle point. 
There is mutual exclusion and one of the species will become extinct 
depending on the initial populations. 


This is a Lotka-Volterra model with critical points at O = (0, 0) and A = (3, 
2). The system is structurally unstable. The populations oscillate but the 
cycles are dependent on the initial values of x and y. 


This is a predator-prey model. There are three critical points in the first 
quadrant at O = (0, 0), F = (2, 0), and G = CA +). The points O and F are 


saddle points and G is a stable focus. In terms of species behavior, the two 
species coexist and approach constant population values. 


Consider the three cases separately. 


(i) 


If Q< u< i, then there are four critical points at O = (0, 0), L = (2, 


0), M = (0, p), and N= | EA aed) The point O is an unstable 
~ (l? R- 


node, L and M are saddle points, and N is a stable point. To classify 
the critical points, consider det J and trace J. The two species 
coexist. 

Gi) 


If 1 < u < 2, then there are three critical points in the first quadrant, 


1 
all of which lie on the axes. The point O is an unstable node, L is a 
stable node, and M is a saddle point. Species y becomes extinct. 

(iii) 

If p > 2, then there are four critical points in the first quadrant. The 
point O is an unstable node, L and M are stable nodes, and N is a 
saddle point. One species becomes extinct. 


10. 


taJ 
A predator-prey model. There is coexistence; the populations stabilize 
to the point (3, i). 


(b) 
A competing species model. There is mutual exclusion; one species 
becomes extinct. 


There are three critical points in the first quadrant if 0 < € < 1: at O = (0, 0), 
A = (4,0) and B = (4+5, 4). There are two when e 2 1. The origin is 
E€ 


l+e2?’ 1+e? 


always a col. When € = 0, the system is Lotka-Volterra, and trajectories lie 
on closed curves away from the axes. If 0 < € < 1, A is a col, and B is stable 
since the trace of the Jacobian is negative and the determinant is positive. 
When € => 1, A is stable. 


There are three critical points at O = (0, 0), P = (1, 0), and Q = (0. 6, 0. 24). 
Points O and P are cols and Q is stable. There is coexistence. 


There is a limit cycle enclosing the critical point at (0. 48, 0. 2496). The 
populations vary periodically and coexist. 


One example would be the following. X and Y prey on each other; Y has 
cannibalistic tendencies and also preys on Z. A diagram depicting this 
behavior is plotted in Figure 23.1. 


Let species X, Y, and Z have populations x(t), y(t), and z(t), respectively. 
The interactions are as follows: X preys on Y; Z preys on X; Y and Z are in 
competition. 


23.5 Chapter 5 


1. 
Convert to polar coordinates to get 


r= fi -2-300526 = —] + A 
= 2 > = 2 à 


Figure 23.1 One possible interaction between three interacting insect species . 


Since ġ < 0, the origin is the only critical point. On y = 1, * > 0, and 


1 
2 
on r= 2, 7 < 0. Therefore, there exists a limit cycle by the corollary to the 


Poincaré-Bendixson Theorem. 


Plot the graph of y = x — x °cos*(x) to prove that the origin is the only 
critical point inside the square. Linearize to show that the origin is an 
unstable focus. Consider the flow on the sides of the rectangle, for 
example, on x = 1, with- 1 <y < 1, x = -y+cosz < 0. Hence the flow 


is from right to left on this line. Show that the rectangle is invariant and use 
the corollary to the Poincaré-Bendixson Theorem. 


(a) Substitute for y from x = 0 and plot the graph of y = x 8 - 3x © + 3x 4- 


2x * + 2 to prove that the origin is a unique critical point. Convert to polar 
coordinates to get 


A r(1 — r’(cos* 6 + sin’ 6), 6 = 1 — r°? cos @sin Asin’ 6 — cos? 6). 


Now div(X) = 2 - 3r ° and so div(X) is nonzero in the annulus A = {1 < r < 
2}. On the circle r= 1-e, + > 0, and onthe circler=2+¢, 7 <0. 


Therefore there is a unique limit cycle contained in the annulus by Dulac’s 


criteria. (b) Convert to polar coordinates and consider the annular region 
1 1 
—— <r<—. 
VHFP yu 


Convert to polars and use the Poincaré-Bendixson theorem. 


Consider the nullcline curves. If the straight line intersects the parabola to 
the right of the maximum, then there is no limit cycle. If the straight line 
intersects the parabola to the left of the maximum, then there exists a limit 
cycle. 
one ie. Sa 
The limit cycle is circular. (b) The limit cycle has fast and slow 
branches. 


It will help if you draw rough diagrams. 

a) 
Now div(X) = -(1 + x ? + x 4) < 0. Hence there are no limit cycles by 
Bendixson’s criteria. 

(b) , ae DE 
Now div(X) = 2 — x. There are four critical points at (0, 0), (1, 0), (-1, 
1), and (-1, —1). The x axis is invariant. On x = 0, y = 2y? > 0). 


Hence there are no limit cycles in the plane. 


c 
Now div(X) = -6 - 2x ? < 0. Hence there are no limit cycles by 
Bendixson’s criteria. 

(d) | oe 
Now div(X) = -3 - x ° < 0. Hence there are no limit cycles by 
Bendixson’s criteria. 


e 
Now div(X) = 3x - 2, and div(X) = 0 on the line y = . There are 


three critical points at (1, 0), (-1, 0), and (2, 3). The x-axis is 
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invariant, and x < Q0 for y > 0 onthe line y — 2. Hence there are no 


WIN 


limit cycles by Bendixson’s criteria. 

i Now div(X) = -3x ? y *. Therefore there are no limit cycles lying 
entirely in one of the quadrants. However, y = —y? on the line x = 0 
and y = 3° on the line y = 0. Hence there are no limit cycles by 
Bendixson’s criteria. 


Now div(X) = (x - 2)*. On the line x = 2, + = —y*, and so no limit 


cycle can cross this line. Hence there are no limit cycles by 
Bendixson’s criteria. 


(a) 
The axes are invariant. Now div(wX) = 1 (29%) and so div(w X) 
xy~ 


= 0 when x = 1. There are four critical points and only one, (—16, 38), 


lying wholly in one of the quadrants. Since the divergence is nonzero 
in this quadrant, there are no limit cycles. 


(b) 
Now div(wX) = -2 — g and so div(wy X) = 0 when y = 2. Since ó 


> 0 and d > 0, there are no limit cycles contained in the first quadrant. 


(a) The one-term uniform expansion is x(t,€) =a cos(s)(1 ae ( i n e) 4 
++) + Ole SE > 0. 


l See Section 5.4. 


23.6 Chapter 6 


1. 


10. 


x4. There are three critical points: 


The Hamiltonian is H(x,y) = y s 


777t 
(0, 0), which is a saddle point and (1, 0) and (—1, 0), which are both centers. 


There are three critical points: (0, 0), which is a center, and (1, 0) and (-1, 
0), which are both saddle points. 


The critical points occur at (n7, 0), where n is an integer. When n is odd, 

the critical points are saddle points, and when n is even the critical points 
are stable foci. The system is now damped and the pendulum swings less 
and less, eventually coming to rest at 0 = 2nm degrees. The saddle points 

represent the unstable equilibria when 8 = (2n + 1) degrees. 


The Hamiltonian is H(x,y) = yt y* x xt. There are nine critical 
g= 


Tor ag 
points. 
(a) n 
The origin is asymptotically stable. 
(b) ee l 
The origin is asymptotically stable if x < a and y < f. 
(c) 


The origin is unstable. 


The origin is asymptotically stable. The positive limit sets are either the 
origin or the ellipse 4x °? + y * = 1, depending on the value of p. 


The function V (x, y) is a Lyapunov function if g > L. 


The basin of attraction of the origin is the circle x° + y ? < 4. 


Use Python. 


The basin of attraction is V(x, y) = x? + 3xy + 3y? < + 
a i = 36. 


23.7 Chapter 7 


1. 


(a) 


There is one critical point when p < 0, and there are two critical 
points when p > 0. This is a saddle-node bifurcation. 

(b) 
When p < 0, there are two critical points and the origin is stable. 
When p > 0, there is one critical point at the origin which is unstable. 
The origin undergoes a transcritical bifurcation. 

(c) 
There is one critical point at the origin when p < 0, and there are three 
critical points—two are unstable—when p > 0. This is called a 
subcritical pitchfork bifurcation. 


Possible examples include 


(a) 
X= ux — x”); 
(b) 
X= x4 — p?; and 
(c) 


X= x(u? + x7 - 1)- 


The critical points are given by O = (0, 0), A = 12+¥169-125h, and 
5 
B = 122 V169-125h. There are two critical points if h < 0, the origin is 
5 


unstable, and A is stable (but negative harvesting is discounted). There are 
three critical points if 0 < h < 1. 352, the origin and A are stable, and B is 
unstable. There is one stable critical point at the origin if h > 1. 352. 

The term x(1 — =) represents the usual logistic growth when there is 


no harvesting. The term - s represents harvesting from h is zero up to a 
LTA 


maximum of h, no matter how large x becomes (plot the graph). 


When h = 0, the population stabilizes to 5 x 10°; when 0 < h < 1. 352, 


the population stabilizes to A x 10°; and when h > 1. 352, the population 
decreases to zero. Use animation in Python to plot x as h varies from zero 


to eight. The harvesting is sustainable if 0 < h < 1.352, where the fish 
persist, and it is unsustainable if h > 1.352, when the fish become extinct 
from the lake. 
(a) ae eee | EPESA 
No critical points if u < 0. There is one nonhyperbolic critical point at 
O = (0, 0) if u = 0, and there are two critical points at A = (0, m) 


and B = (0, — <u). Both A and B are unstable. 


(b) 
There are two critical points at O = (0, 0) and A = (p ?, 0) if u #0 
(symmetry). O is stable and A is unstable. There is one nonhyperbolic 
critical point at O = (0, 0) if p = 0. 
(c) 
There are no critical points if u < 0. There is one nonhyperbolic 
critical point at O = (0, 0) if u = 0, and there are four critical points at 


A = (2,0), B = (-2 yu,0), C = (42,0), and D = (- ya, 0) 


if p > 0. The points A and D are stable, while B and C are unstable. 


(a) 


If u < 0, there is a stable critical point at the origin and an unstable 
limit cycle of radius r = —p. If u = 0, the origin is a center, and if u > 
0, the origin becomes unstable. The flow is counterclockwise. 

(b) 
If u < 0, the origin is an unstable focus. If u > 0, the origin is unstable, 
and there is a stable limit cycle of radius y = 5 and an unstable limit 


cycle of radius r = p. 


(c) 


If u # 0, the origin is unstable and there is a stable limit cycle of 
radius | r | = p. If u = 0, the origin is stable. 


Take X =u + f ,(u). Then, if the eigenvalues of J are not resonant of order 
3, 


10. 


. a0 , _ ay . z » _ 409 
fo = FA fi = Lita fiz = Tay Jo = ae 

0g, a a l a 
830 a; as §21 a §12 A cay 803 2A 


and all of the cubic terms can be eliminated from the system resulting 
in a linear normal form ù = Ju. 


See the book of Guckenheimer and Holmes referenced in Chapter 9 


(a) 


There is one critical point at the origin and there are at most two 
stable limit cycles. As p increases through zero there is a Hopf 
bifurcation at the origin. Next there is a saddle-node bifurcation to a 
large-amplitude limit cycle. If pt is then decreased back through zero, 
there is another saddle-node bifurcation back to the steady state at the 
origin. 

(b) 


If u < 0, the origin is unstable, and if p = 0, 7 > Q if r #0 the origin is 


unstable and there is a semistable limit cycle at r = 1. If > 0, the 
origin is unstable, there is a stable limit cycle of radius 

24u- 4/22444 and an unstable limit cycle of radius 
pa ve +4u 


2 


d44+/,244,- It is known as a fold bifurcation because a fold in 
= +u+ y u“+4u 


the graph of y = (r — 1)? -ur crosses the r-axis at u = 0. 


If p < 0, the origin is a stable focus and as p passes through zero, the origin 
changes from a stable to an unstable spiral. If u > 0, convert to polars. The 
origin is unstable and a stable limit cycle bifurcates. 


The critical points occur at A = (0, — 3) and B = (a + p, 1). Thus there are 


two critical points everywhere in the (a, p) plane apart from along the line 
a = -fp where there is only one. The eigenvalues for the matrix J , are A 4 = 


Band ) >= _ (e+/), The eigenvalues for the matrix J g are 
p 


Jam [y2—4(+p)- There is a codimension-2 bifurcation along the line a 
= M 


= -f and it is a transcritical bifurcation. 


23.8 Chapter 8 


1. 


Eigenvalues and eigenvectors given by [3, (-2, -2, 1)"], [-3, (-2, 1, -2)"], 
and [9, (1, -2, -2)"]. The origin is unstable; there is a col in two planes and 
an unstable node in the other. 


Eigenvalues are } ‘=l i V6, 4 = 1: The origin is unstable and the 


flow is rotating. Plot solution curves using Python. 


There are two critical points at O = (0, 0, 0) and P = (-1, —1, —1). The 
critical points are both hyperbolic and unstable. The eigenvalues for O are 
[1, 1, -1] and those for P are [1, —1, —1]. 


Consider the flow on x = 0 with y > 0 and z = 0, etc. The first quadrant is 
positively invariant. The plane x + y + 2z = k is invariant since 
ž + ý + 2ż = 0. Hence if a trajectory starts on this plane, then it remains 


there forever. The critical points are given by ( ): Now on the 


AY a as 
plane x + y + 2z =k, the critical point satisfies the equation 

= 
2 tyty=k which has solutions = (2-a)+ deae Since the first 


quadrant is invariant, A *(p) must tend to this critical point. 
(a) Day 
Take V=x4+y4+z<. Then 
V= - (£ +y +0 -2P 4-2) < 0: Now vy = 0 if and 


only if x = y = z = 0; hence the origin is globally asymptotically 
stable. 
(b) l 
Consider V = ax ° + by ° + cz ?. Now 
V = -2(a*x? + b*y* + c72’) + 2xyz(ax + by + cz). Hence 


V< 2 — 2cy and ý < 0 in the set V < 2c *. Therefore the origin is 


10. 


asymptotically stable in the ellipsoid V < 2c °. 


See the Python program listed in Chapter 8. 


There are eight critical points at (0, 0, 0), (0, 0, 1/2), (0, 1/2, 0), (0, 1, -1), 
(12, 0, 0), C13, 0, 1/3), (13, - 13, 0), and (1114, 3114, 3/14). The plane x + y 
+ z = 1/2 is a solution plane since 

x+yt2=(x+y4+z)-—2(x+y+4z) = 0 on this plane. There are 


closed curves on the plane representing periodic behavior. The three 
species coexist and the populations oscillate in phase. The system is 
structurally unstable. 
(i) 
The populations settle onto a period-2 cycle. (ii) The populations 
settle onto a period-4 cycle. 


Use Python to plot a time series. 


A Jordan curve lying wholly in the first quadrant exists, similar to the limit 
cycle for the Liénard system when a parameter is large. The choice of q 
and C are important. 


23.9 Chapter 9 


1. 
Starting with r ọ = 4, the returns are r į = 1. 13854, r 5 = 0. 66373, ..., r 19 = 
0. 15307, to five decimal places. 
2. 
' : SS i 
The Poincaré map is given by +,,,; = P(r„) = ETE EAA 
3. 
Now $ — e~2#, Therefore the limit cycle at r = p is hyperbolic stable if 
ar H 
u > 0 and hyperbolic unstable if u < 0. What happens when p = 0? 
4. 
The Poincaré map is given by 2 5. 
Fn+1 = Pirn) = m] 
5. 
The limit cycle at r = 1 is stable since — = gon, 
6. (a) 
The Poincaré section in the p 4 q ; plane is crossed 14 times. (b) The 
trajectory is quasiperiodic. 
7. 
Edit the Python program listed in Chapter 9 
8. 
Edit the Python program listed in Chapter 9 
9. 
A chaotic attractor is formed. 
10. 
(a) 
See Figure 23.2(a). 
(b) 


See Figure 23.2(b). Take T = 0.07. For example, choose initial 
conditions (i) x ọ = 1. 16, y ọ = 0. 112 and (ii) x g = 0. 585, y 9 = 0. 29. 


0.04 0.08 0.12 
002040608 1 1.2 14 


X 


Figure 23.2 (a) Bifurcation diagram . (b) Multistable behavior. 


23.10 Chapter 10 


1. 


10. 


Differentiate to obtain 2ui = G’(x)x and find 2. 
au 


Using Python: ffx? = 3xy + 9y?, 0, =26y* 36yz _ 26274 -25z°} and 


{{9. 9 + x —3xy,-27 +y? + yz + Zh ,—21z + rat 


Lex {y° _ y4 _ 2y6 a y’, y y? 4 yí _ y} DegLex 


{-x? +y,—x4 = ys DegRevLex {-x ee yt. 
Solutions are (0, 0), (-0. 471074, 0. 605423), and (1. 46107, 1. 28760). 


The Lyapunov quantities are given by L(i) = a 5;,;, where i = 0 to 6. 
See the Lloyd and Lynch paper in the Bibliography. 


The Lyapunov quantities are given by L(0) = -a 4, L(1) = -3b 93 — b 
21 L(2) = —3b 39 b o3 = b 41, and L(3) = b o3 *. 


The homoclinic loop lies on the curve y? = y? + - x. 


There are three limit cycles when A = —0. 9. 


23.11 Chapter 11 


1. There is one critical point in the finite plane at the origin which is a stable 
node. The eigenvalues and eigenvectors are given by A 4 = —1, (1, —1)f and à 5 


= —4, (1, -4)", respectively. The function g (0) is defined as 
g2(0) = —4 cos? @ — 5 cos Asin 6 — sin? 0. 


There are four critical points at infinity at 0 , = tan" '(-1), 0, = tan ‘(-1) + 7, 
8 > = tan™t(—4), and 6 , = tan '(—4) + x. The flow in a neighborhood of a 
critical point at infinity is qualitatively equivalent to the flow on X = 1 given 
by 

y = =y = Sy = 4, 75 V7, 


There are two critical points at (—1, 0), which is a col and (—4, 0), which is an 
unstable node. Since n is odd, antinodal points are qualitatively equivalent. 


2. There is one critical point in the finite plane at the origin which is a col. The 
eigenvalues and eigenvectors are given by A , = 1, (1, 1)? and å 5 = -1, (2, 1), 
respectively. The function g (0) is defined as 


g2(0) = -2 cos? 8 + 6cos @sin 6 — 4 sin? 0. 


There are four critical points at infinity at 6 , = tan™1(1), 0 = tan™t(1) + m, 0 > 
= tan™t(1⁄2), and 0 4 = tan™t(1⁄2) + 7. The flow in a neighborhood of a critical 
point at infinity is qualitatively equivalent to the flow on X = 1 given by 


ý = -4y + 6y- 2, ż= 3z- 4yz. 


There are two critical points at (1, 0), which is a stable node and (1⁄2, 0), 
which is an unstable node. Since n is odd, antinodal points are qualitatively 
equivalent. 


There are no critical points in the finite plane. The function g 3(0) is given 
by 


@3(0) =4 cos’ @sin 0 — sin? 0. 


The function has six roots in the interval [0, 27r), at 0 4 = 0, 85 = 1.10715, 
8 > = 2.03444, 0 4 = 3.14159, 0 ; = 4. 24874, and 6 ș = 5. 1764. All of the 


angles are measured in radians. The behavior on the plane X = 1 is 
determined from the system 


; 2 3 2 : 2 £ 
y =4y-57 -y +y, ż=-z-y +z. 


There are three critical points at O = (0, 0), A = (2, 0), and B = (-2, 0). 
Points A and B are stable nodes and O is a col. Since n is even, antinodal 
points are qualitatively equivalent, but the flow is reversed. 

All of the positive and negative limit sets for this system are made up 
of the critical points at infinity. 


There is one critical point at the origin in the finite plane which is a stable 
focus. The critical points at infinity occur at 8 4 = 0 radians, 6) = 4 


radians, 6; = —5 radians, and @ 4 = m radians. Two of the points at infinity 


are cols and the other two are unstable nodes. 


There is a unique critical point in the finite plane at the origin which is an 
unstable node. The critical points at infinity occur at 8 , = 0 radians, 


6, = $ radians, 03; = —4 radians, and 8 4 = 7 radians. Two of the points at 


infinity are cols and the other two are unstable nodes. There is at least one 
limit cycle surrounding the origin by the corollary to the Poincaré- 
Bendixson Theorem. 


If a į a3> 0, then the system has no limit cycles. If a ; a 3 < 0, there isa 
unique hyperbolic limit cycle. If a , = 0 anda 3 #0, then there are no limit 
cycles. If a = 0 anda , #0, then there are no limit cycles. If a į = a 3 = 0, 
then the origin is a center by the classical symmetry argument. 


When € is small one may apply the Melnikov theory of Chapter 11 to 


10. 


establish where the limit cycles occur. The limit cycles are asymptotic to 
circles centered at the origin. If the degree of F is 2m + 1 or 2m + 2, there 
can be no more than m limit cycles. When € is large, if a limit cycle exists, 
it shoots across in the horizontal direction to meet a branch of the curve y = 
F(x), where the trajectory slows down and remains near the branch until it 
shoots back across to another branch of F(x) where it slows down again. 
The trajectory follows this pattern forever. Once more there can be no 
more than m limit cycles. 


Use a similar argument to that used in the proof to Theorem 4. See 
Liénard’s paper in Chapter 5. 


The function F has to satisfy the conditions a , > 0, a3 <0, and a 3 ° > 4a 
1 for example. This guarantees that there are five roots for F(x). If there is 
a local maximum of F(x) at say (a ,, 0), a root at (a 5, 0), and a local 
minimum at (a 3, 0), then it is possible to prove that there is a unique 
hyperbolic limit cycle crossing F(x) in the interval (a 4, a 5) and a second 
hyperbolic limit cycle crossing F(x) in the interval (a 3, 00). Use similar 
arguments to those used in the proof of Theorem 4. 


23.12 Chapter 12 


1.,2. 
Work out the solution on [-1, 2] by hand and then edit the Python 
program listed in Section 12.1 to determine the analytical solution on 


[-1, 4]. 

5. 
Edit the Python program listed in Section 12.2. There is periodic, 
quasiperiodic, and possibly chaotic behavior. 

Z: 
When the global warming term W is small we see no discernible 
difference in the steady-state solutions; however, when the global 
warming gets too large, the oscillatory solution disappears. 

8. 
It will help if you plot Poincaré sections. (i) Periodic; (ii) quasiperiodic; 
(iii) chaotic. 

9. 


See the paper cited in the question. 


10. 
See the paper cited in the question. 


23.13 Chapter 13 
i 


The general solution is x „ = #(4n + cn(n - 1)). 


2. 
2 x 3” = 2"; (b) 2 "63n + 1); (©) 23 (cos(nz/4) + sin(nz/4)); 
(d) | | 
Fa = [+ V5)"- (1 - v5}; 
(e) (i) 
e222) 1 
(ii) 
xa = MED +2" 404s 
(iii) 
Xn = +(-1)" 4: 22" = Ze"(-1)" z Fe" + te”. 
3. 
The dominant eigenvalue is A , = 1. 107 and 
(@) 64932 
X> =| 52799 |; 
38156 
b 
(b) 2271x 10° 
XO% =| 1.847 x 108 |; 
1.335 x 10° 
©) 3.645 x 108 
X0% =|} 2,964 x 10° 
2.142 x 10° 


The eigenvalues are A į = 1 and basci v3. There is no dominant 
3 ~~ 2 


eigenvalue since | A ; | =|A>|=|A3 |. The population stabilizes. 


The eigenvalues are 0,0, — 0. 656 + 0. 626i, and A , = 1. 313. Therefore the 


population increases by 31. 3% every 15 years. The normalized 
eigenvector is given by 


Before insecticide is applied, A , = 1. 465, which means that the population 
increases by 46. 5% every 6 months. The normalized eigenvector is 


After the insecticide is applied, A ; = 1.082, which means that the 


population increases by 8. 2% every 6 months. The normalized eigenvector 
is given by 


For this policy, d , = 0. 1, d = 0. 4, and d 3 = 0.6. The dominant 
eigenvalue is A į = 1.017 and the normalized eigenvector is 


10. 


Without any harvesting the population would double each year since A į = 


(b) 


h, =6/7; =| 2/9 


(c) 
0.780 
A, = 1.558; X =| 0.167 
0.053 


(d) 
h, = 0.604, a, = 1.433; -=| 0.177 
(e) 
0.668 


A, = 1.672; X=| 0.132 
0.199 


Take h » =h } = 1, then à į = 1,À = —-1, and À 3 = 0. The population 
stabilizes. 


23.14 Chapter 14 


1. 
The iterates give orbits with periods (i) one, (ii) one, (iii) three, and (iv) 
nine. There are two points of period one, two points of period two, six 
points of period three, and twelve points of period four. In general, there 
are 2N-(sum of points of periods that divide N) points of period N. 
2. 
(a) l l 
The functions are given by 
9 1 
a 
5753y Saas 
T(x =42 4 3 2 
4 4 2> 3 
4 1 - x) 3 <x<l 
and 
aT 2 
a ol 
seS 
EE 
yy ad 4 BX S3 
IOV ES Be es 
BRE USS) 
a -7 FSX<G 
Al- 55 2<1 
There are two points of period one, two points of period two, and 
no points of period three. 
©) 9 45 81 45 81 
X1179 xo = Fp x21 = Re wo = Ge 431 = Be 32 = Ep 
— 126 — 225 = 45, y, = 2. 
43,3 = 951° “3,4 — 954’ Apr “3,6 — 954 
4. 


Use functions of functions to determine f T N There are two, two, six, and 
twelve points of periods one, two, three, and four, respectively. 


A value consistent with period-two behavior is p = 0. 011. Points of period 
two Satisfy the equation 


ux? — 100u7x — ux + 100 + 1 = 0. 


6. 
Edit a program from Section 14.6. 
7. 
Points of period one are (—3/10, -3⁄10) and (14, 15). Two points of period 
two are given by (x y2, (0. 1 — x ,/2), where x , is a root of 5x*-x-1=0. 
The inverse map is given by 
10 3 2 
Xn+1 = Yn Yn+1 = D Xn 7 50 + Yn]- 
8. 
(a) 
The eigenvalues are given by Ain = -ax + VL +B A 
bifurcation occurs when one of the | A | = 1. Take the case where A = 
-1. 
(c) sp ate te 
The program is listed in Section 14.6. 
9. (a) 
(i) When a = 0. 2, c 41 = 0 is stable, c 4 5 = 0. 155 is unstable, and c 4 3 
= 0. 946 is stable. (ii) When a = 0. 3, c 41 = 0 is stable, c 4 p = 0. 170 is 
unstable, and c ; 3 = 0. 897 is unstable. 
10. 


See the Ahmed paper in the Bibliography. 


23.15 Chapter 15 


1 
a 
The orbit remains bounded forever, Z 599 ¥ —0. 3829 + 0. 1700i; 
(0) mae 197 197 
the orbit is unbounded, Z 1) = —0. 6674 x 10-7” + 0. 2396 x 10°”. 
2. 
Fixed points of period one are given by 
| i | 
ava 10+2 V4 >a 2 V41 — 10, 
l- i o] 
“| 10 +2 a 2 V41 — 10. 
Fixed points of period two are given by 
a i ly i J2 v77 
Fi 4 
EE y2 + V17 + 5 V2Vi7 
va a 
3. 
Use the Python program listed in Chapter 15; J(0, 0) is a circle and J(-—2, 0) 
is a line segment. 
4. 
There is one fixed point located approximately at z 4 , = 1. 8202 — 0. 0284i. 
5. 
See the example in the text. The curves are again a cardioid and a circle but 
the locations are different in this case. 
k 


Fixed points of period one are given by 


34+ VO-4c 3- V9- 4c 


Fixed points of period two are given by 


1+ V5 -4c l- v5-4c 


REL SS 5 S22 = 
2 2 


9. 
(i) Period four and (ii) period three. 


10. 
There are regions where periodic points fail to converge. You should write 
your program so that these points are plotted in black. 


23.16 Chapter 16 


1. 
There are 11 points of period one. 


2. 
See the programs in Section 16.7. 


3. 
Find an expression for E „in terms of E „+1 


See the paper of Li and Ogusu in the Bibliography. 

(a) . =) =2 
Bistable: 4. 765 — 4. 766 Wm ^. Unstable: 6. 377 — 10.612 Wm ~. (b) 
Bistable: 3. 936 — 5. 208 Wm °. Unstable: 4. 74 - 13. 262 Wm ~. (c) 
Bistable: 3. 482 - 5.561 Wm *. Unstable: 1.903 - 3.995 Wm °. 


-bx? to generate the Gaussian pulse . The 


Use the function G(x) = ae 


parameter b controls the width of the pulse. 


23.17 Chapter 17 


1. a) 


The length remaining at stage k is given by 


The dimension is p p= ms ~ 0.6826- 


(b) 
D= tn2_ — 2. If the fractal was constructed to 
In V2 
infinity, there would be no holes and the object 
would have the same dimension as a plane. Thus 
this mathematical object is not a fractal. 


The figure is similar to the stage 3 construction of the 
Sierpinski triangle. In fact, this gives yet another 
method for constructing this fractal as Pascal’s triangle 
is extended to infinity. 


See Figure 17.8 as a guide. 


4. The dimension is Dy = ny ~ 1.8928- 
6. 

si = [0, 2| U |3, Lh 

S2 = [0, klo [h 4 o B 8] u [8,1] 2 r705. 
7. 


(i) The fractal is homogeneous; (ii) @ max ® 1. 26 and a 
min © 0. 26; (iii) a max © 0. 83 and @ min 7 0. 46. Take k = 
500 in the plot commands. 


Using the same methods as in Example 7: 


dan) 
b4 slnpi+(k-s)lnp S 


D =r p= > 
oe kh3 m 


9. At the kth stage, there are 5% segments of length 3™%. A of these have weight 
number pı% p 5. Use the 


ý same methods as in 
N, = ma : | Example 7. 


10. 
Using multinomials, 


4! 
In nı'no'na!ny! 


In3* ° 


— m inp; +m ln p + nln p3 + n4ln p4 


Qs mI% and — Ís = 


wheren,; +n +tn3+tn4=k. 


23.18 Chapter 18 


For questions 1. 5. 6. 7. and 8., see the Python programs in Chapter 18. 


3. 


10. 


Choose suitable RGB values to identify green pixels. Scan across the 
image with the mouse to gauge values. 


Gaussian function is 


l xX +y 
SU m P\ 9g? | 


Other edge detection algorithms include Prewitt, fuzzy logic, Laplacian of 
Gaussian (LoG), and Canny, for example. 


23.19 Chapter 19 


1 


Take the transformations y, = tu, and y, = 2). 
a z a 


There is one control range when p = 1, there are three control ranges when p 
= 2, seven control ranges when p = 3, and twelve control ranges when p = 4. 


Points of period one are located at approximately (—1. 521, —1. 521) and (0. 
921, 0.921). Points of period two are located near (—0. 763, 1. 363) and (1. 
363, —0. 763). 


See the paper of Chau in the Bibliography. 
See Section 19.3. 


The two-dimensional mapping is given by 


2 2 en 2) 
Xn+1 = Á + B(x, cos(x} + y4) — 2,5, + y4)), 


sap D 2 2 2 
Ynt1 = B(Xn sin(x; + Y;,) + Yn cos(x + y,,))- 


The one point of period one is located near (2. 731, 0. 413). 
C) k a | 
There are three points of period one; (ii) there are nine points of period 
one. 


See our research paper on chaos control in the Bibliography. 


The control region is very small and targeting is needed in this case. The 
chaotic transients are very long. Targeting is not required in Exercise 9, 
where the control region is much larger. Although there is greater flexibility 
(nine points of period one) with this system, the controllability is reduced. 


23.20 Chapter 20 


2. 
Use the chain rule. 
5. 
e Show that 
OW that dV(a) _ da;\*- 
dt = 2 =] (£ (g7! (a; ))) (2 dt y 
(b) l > r 4 
V(a) = E (7a; + 12aja - 2a3}) — — (log (cos(aa;/2)) + log (cos(maz/2))). 
2 yn“ 
There are two stable critical points, one at (12. 98, 3. 99), and the other 
at (-12. 98, -3. 99). 
6. 
The algorithm converges to (a) X 5; b)X 4; (9X 3; (d) - X4. 
8. (a) 
Fixed points of period one satisfy the equation a = ya + 8 + wo(a). 
(b-d) 
See Pasemann’s paper referenced in Chapter 14. 
(e) 
There is a bistable region for 4.5 < w < 5. 5, approximately. 
9. 


Iterate 10, 000 times. A closed loop starts to form, indicating that the system 
is quasiperiodic. 


23.21 Chapter 21 


1. 
The threshold voltage is approximately 6. 3 mV. (a) When I = 8 mV, 
frequency is approximately 62. 5Hz. (b) When I = 20 mV, frequency is 
approximately 80Hz. 
2. 
An example of a Fitzhugh-Nagumo system with a critical point at the 
origin is given by 
x = (x + 0.1)*((x — 0.039)(0.9 — x)) - 0.0035 - y, y = 0.008(x — 2.54y). 
3. 


The inequalities are given by: 


0 A 
or l = X Iwi- Oox, <T 
—_ i Ta 
l 0 0 ; 
forf=| 0 ],] 1 ],] 0 cae 
0 0 1 w2 
1 1 0 . 
ford =} 1 0 l $ Iwi- Ox, <T 
0 l I l Iw. > T 
l A 
= X Iwi -Ôx > T 
-o i TA 


The truth table and time series are shown in Figure 23.3. 


Output 


Input 


i 
(@) 
te) 
O 
"m 
O 
wv 
z 
3 
Ky 
N 
a 
“ 
g 


1000 2000 3000 4000 5000 6000 7000 8000 


0 


time 


10. 


Figure 23.3 (a) Truth table for a 2 x 2 bit binary multiplier. (b) Time series of a 2 x 2 bit binary 
multiplier based on Fitzhugh-Nagumo oscillations. 


See Chapter 6. 


Use the second iterative method, ramp kappa up and down. See Programs 
9d: Bifurcation diagram of the Duffing equation, for a similar example. 


23.22 Chapter 22 


Examination 1 


1 
` (a) 
Eigenvalues and eigenvectors À 4 = 3. 37, (1, 0. 19)7; à 9 = 72. 37, (1, 
-2. 7)". Saddle point, « = 0 on y = -3x y=Oon y= ly. 


(b) 


t> 0when0<0<m, 7 < 0 when z< @< 27, t= 0 when 0 = 0,7, 


6 = 0 when 0 = “mn = 1,2,3,4. 


' (a) 


V = -(x - 2y)» V = 0 when y = $. On y = 3, x,y + 0, therefore, 


Noles 


the origin is asymptotically stable. 


p=, @=t+ Qn. 
t+] 


" (a) 
A,=7-1,A,=-2+i,A 3 =-2-i. Origin is globally asymptotically 


stable. 


(b) 
V= —4y4 — 27+ < 0, ify, z 4 0. Therefore, the origin is 


asymptotically stable, trajectories approach the origin forever. 
(a) 


One limit cycle when p < 0, three limit cycles when p > 0, u # 1, and 
two limit cycles when p = 1. 


(b) PN 
Use Bendixson’s criteria: 
Gi) . 2 4 
divX = -(1 + 3x4 +x °“) <0; 
(ii) 


divX = 3x? y?,onx=0, x > 0, ony=0, ý > 0, no limit cycles 


in the quadrants and axes invariant; 
(iii) 
divX = (1+ y}. On y = -1, ý > 0. 


@) 1: 49 
X11 = 0, x12 =a" X21 = 65° %2,2 = 55’? 
X31 = E, X3,2 = =, X3,3 = Z, x34 = X35 = 0,436 = = a 
b) 
a= l+VB 2) _ l-VB; Z921 = 1l,Z 22 = ~2. Fixed points of period 
SLI = 2 >Sl2=— 2 ? ? 
one are unstable. 
6. (a) 
Area of inverted Koch snowflake is v3 units*, D p> 1.2619. 
10 
(b) l 
Use L’ Hopital. 
7. (a) 
Period one ( 5 1 ) (-1 _1 ) both fixed points are unstable. 
9° 9 23 
(b) 
See Chapter 6. 
8. 
a 
(@) 0 -1 1 1 
1} -1 O 1 1 
W=- 
4| 1 1 0 -I 
1 1 -1 0 
(b) l 
V(a) = e + 2a;a + 4a, + 12a, + 20a2) 


3 +, (log (cos(ma, /2)) + log (cos(ma2/2))). 


Examination 2 


* (a) 
X= —-kix, ý= kx- ky, ż= ky; x(20) = 4.54 x 10, y(20) = 
0. 3422, z(20) = 0. 6577. 


(b) 
Period is approximately T ~ —6. 333. 


(a) 
See Section 10.5, Exercise 6. 


(b) 
eye? 2 », saddle point at origin, center at (1, 0). 
Hy) =5-54+2 


N 


(a) 

Three critical points when u < 0, one when p = 0. 
(b) 

Chaos. 


' (a) 
X 11 = 0,X 12 = 0. 716, X 2 1 = 0. 43, X 2 2 = 0. 858, no points of period 


three, X 4,1 =0. 383, X 4,2 =0. 5, X 4,3 =0. 825, X 4,4 = 0. 877. 


i Z 11 = —0. 428 + 1. 616i, Z 1> = 1. 428 - 1. 616i; Z 3; = -1.312 + 1. 
847i, Z >> = 0. 312 - 1. 847i; Z 3 ı = —1. 452+1. 668i, Z 3) = -1. 269+1. 
800i, Z 3 3 = -0. 327+1. 834i, Z 3 4 = 0. 352-1. 891i, z 35 = 0. 370-1. 
570i, Z 36 = 1. 326-1. 845i. 


(a) 
Fixed points of period one (0. 888, 0. 888), (—1. 688, —1. 688); fixed 
points of period two (1. 410, —0. 610), (—0. 610, 1. 410). 

(b) 


Lyapunov exponent is approximately 0.4978. 


J(0, 1.3): Scattered dust, totally disconnected. 


(a) 
Period-one points (2. 76, 0. 73), (3. 21, -1. 01), (3. 53, 1. 05), (4. 33, 0. 
67). 


A 


(D) 
The Python program to plot a Koch snowflake is listed in the solutions 


for Chapter 1. 
8. 
a 
(@) 0 -1 1 1 -I 3 
-1 0 1 1 3 -1 
1} 1 1 O -1 1 | 
aor ee ee il 
-1 3 1 1 0 -I 
3 -1 1 1 -I1 0 
(b) 
See Chapter 17. 
Examination 3 
* @) 
Eigenvalues and eigenvectors A , = 2, (3, 1)’; A> = —5, (1, -2)". Saddle 
point. 
(b) 
Tal = So per 
2. (a) 
Critical points at (0, 0) and (0, p — 1). Critical point at origin is unstable 
for u < 1 and stable for p > 1. Other critical point has opposite stability. 
(b) 
One unstable limit cycle when p < 0. Critical point at origin is stable 
when u < 0 and unstable when p > 0. 
3. (a) 
Critical points at (0, 0, 0), (0, 0, 1), (0, 1, 0), (1, 0, 0), (1, 0, 1), and 
$, b, +): Critical point away from axes is stable. 
(b) , l 
Z 41 = 1. 6939 — 0. 4188i, Z 4 2 = —0. 6939 + 0. 4188i, Z ı 2 = —1. 3002 + 
0. 6248i, Z > 5 = 0. 3002 — 0. 6248i. 
4. 


(a) 


Critical point at (0. 5, 1. 428), is an unstable focus. 


(b) 
There exists a limit cycle by the Poincaré-Bendixson theorem. 


" (a) 
Determine an expression for E , in terms of E ,,4. 
(b) 
Fixed point at k © 0. 26, is stable when B = 1, and fixed point k % 0. 92 
is unstable when B = 4. There is a bifurcation when B * 0. 36. 


(a) 


Period one fixed points at (2, 1) and (-§, —+). Period two fixed 
oints at (12 _3) and (_& 5). 
p (i? CT 17) 


(b) 
Sı = ft, 2] u [ż, £]; Dr 0- 3869. 


(a) 
Eigenvalues are A , = 2. 5150, À = —1. 7635, À 3 = —0. 7516. Long- 
term population is [0. 8163; 0. 1623; 0. 0215]. 

(b) 
Edit Program 17b. 


' (a) 
Lyapunov exponent=0.940166. 
(b) l 
N_lines=2**k;h=3**(-k); 
angle=[np.pi/4, - 
np.pi/4];segment[j]=np.mod(m,2);m=floor(m/2). 


Appendix A Index of Python Programs 
Readers can download the Python program files via GitHub: 
https://github.com/springer-math/dynamical-systems-with-applications- 
using-python 
These files will be kept up-to-date and extra files will be added in the 
forthcoming years. 


A.1 IDLE Python Programs 


These files include solutions to the Exercises listed in Chapter 1 


euclid_algorithm.py --- See Exercise 10. 
F2C.py --- See Exercise 1(a). 
F2K.py --- Converts degrees Fahrenheit to Kelvin. 


fibonacci.py -- 

- Lists first n terms of the Fibonacci sequence. 
fmu.py --- The logistic function. 
fractal_tree.py --- Plots a fractal tree. 
fractal_tree_color.py -- 

- Plots a color fractal tree. 


grade.py --- Converts a score to a grade. 
guess_number.py --- Guess the number game. 
koch_snowflake.py --- See Exercise 1(d). 
koch_square.py --- Plots a Koch square fractal. 
Pythag_Triples.py --- See Exercise 1(c). 


sierpinski.py -- 

- Plots a Sierpinski triangle fractal. 
sierpinski_square.py -- 

- Plots a Sierpinski square fractal. 
Sum_primes.py --- See Exercise 1(b). 
sum_n.py --- Sums the natural numbers to n. 


A.2 Anaconda Python Programs 
If you have difficulty with the animation programs in Spyder, you have to 


change the backend to run an animation in the [Python console. You can do that 
by running 


In[1]: % matplotlib qt5 


before the animation. If you don’t want to use this command every time, you can 
go to: Tools, Preferences, [Python Console, Graphics, Backend, and change it 
from “Inline” to “Automatic.” 


Program_O1a.py --- Solve a simple ODE. 
Program_0ib.py --- Solve a second order ODE. 
Program_Oic.py --- Plot two curves on one graph. 
Program_Oid.py --- Subplots. 

Program_O1e.py --- Surface and contour plot in 3D. 
Program_0if.py --- A parametric curve in 3D. 
Program_01g.py --- Animation of a simple curve. 
Program_02a.py --- Solve a separable ODE. 
Program_02b.py --- Solve the logistic ODE. 
Program_02c.py --- Power series solution. 


Program_O2d.py -- 

- Power series solution for van der Pol. 
Program_O2e.py -- 

- Plot series solution against numerical 


solution. 
Program_02f.py --- Solve a linear first order ODE. 
Program_02g.py --- Solve a linear second order ODE. 


Program_O3a.py -- 
- Plot the phase portrait of a linear system. 
Program_O3b.py -- 
- Plot the phase portrait of a nonlinear 
system. 
Program_03c.py --- Finding critical points. 


Program_04a.py -- 
- Phase portrait and time series of Holling- 
Tanner model. 


Program_O5a.py --- Limit cycle of a Fitzhugh- 
Nagumo system. 
Program_O5b.py -- 


- Approximate and numerical solutions to ODEs. 
Program_O5c.py --- Error between one- 
term and numerical 


solution. 
Program_O5d.py --- Lindstedt-Poincare technique. 
Program_06a.py --- Contour plot. 
Program_06b.py --- Surface plot. 
Program_O7a.py --- Animation of a simple curve. 


Program_O7b.py -- 
- Animation of a subcritical Hopf bifurcation. 


Program_O7c.py --- Animation of a SNIC bifurcation. 
Program_08a.py --- The Rossler attractor. 
Program_08b.py --- The Lorenz Attractor. 
Program_08c.py --- The Belousov- 


Zhabotinsky reaction. 
Program_08d.py -- 
- Animation of a Chua circuit bifurcation. 


Program_09a.py --- Simple Poincare return map. 
Program_09b.py -- 

- Hamiltonian with two degrees of freedom plot. 
Program_O9c.py -- 

- Phase portrait and Poincare map for the 

Duffing system. 

Program_09d.py -- 

- Bifurcation diagram of Duffing equation. 


Program_10a.py --- Computing Lyapunov quantities. 
Program_10b.py -- 
- Division algorithm for multivariate 


polynomials. 
Program_10c.py --- S-polynomial. 
Program_10d.py --- Computing the Groebner basis. 


Program_10e.py -- 
- Computing Groebner basis of Lyapunov 
quantities. 


Program_10f.py -- 

Animation of a homoclinic limit cycle 
bifurcation. 

Program_10g.py -- 

Animation of a homoclinic limit cycle 
bifurcation. 


Program_iia.py -- 
Animation of a Lienard limit cycle. 


Program_12a.py --- The method of steps. 
Program_12b.py -- 
Plot of solution by method of steps. 


Program_12c.py --- The Mackey-Glass DDE. 
Program_12d.py --- The Lang-Kobayashi DDEs. 
Program_13a.py --- Computing bank interest. 


Program_13b.py -- 

Solving a second order recurrence relation. 

Program_13c.py -- 

The Leslie matrix, eigenvalues and 
eigenvectors. 


Program_14a.py -- 

Graphical iteration of the tent map. 

Program_14b.py -- 

Bifurcation diagram of the logistic map. 

Program_14c.py -- 

Computing Lyapunov exponents for the 
logistic map. 

Program_14d.py --- Iteration of the Henon map. 

Program_14e.py -- 

Lyapunov exponents of the Henon map. 


Program_15a.py --- Point plot for a Julia set. 
Program_15b.py --- Colormap of a Julia set. 
Program_15c.py --- Color Mandelbrot set. 


Program_15d.py --- Color Newton fractal Julia set. 


Program_16a.py --- Intersection of implicit curves. 
Program_16b.py -- 

Chaotic Attractor of the Ikeda map 
Program_16c.py -- 

Bifurcation diagram of the Ikeda map. 


Program_17a.py --- The Koch curve. 

Program_17b.py -- 

Chaos game and the Sierpnski triangle. 

Program_17c.py --- Barnsley’s fern. 

Program_17d.py -- 

Subplots of tau, D_q and f(alpha) 
multifractal spectra. 


Program_18a.py --- Generating a multifractal image 
Program_18b.py -- 
Counting pixels in a color image. 
Program_18c.py -- 
Image and statistical analysis on 

microbes.png 
Program_18d.py -- 
Fast Fourier transform of a noisy signal 
Program_18e.py --- Iterative map and power spectra 
Program_18f.py -- 
Fast Fourier transform of Lena image 
Program_18g.py --- Edge detection in Lena image 


Program_19a.py -- 
Chaos control in the logistic map. 
Program_19b.py --- Chaos control in the Henon map. 
Program_19c.py -- 
Chaos synchronization between two Lorenz 
systems. 
Program_19d.py --- Generalized synchronization. 


Program_20a.py -- 

The generalized delta learning rule. 
Program_20b.py --- The discrete Hopfield network. 
Program_20c.py -- 


- Iteration of a minimal chaotic neuromodule. 
Program_20d.py -- 
- Bifurcation diagram of neuromodule. 


Program_21a.py --- The Hodgkin-Huxley equations. 
Program_21b.py --- The Fitzhugh-Nagumo half-adder. 
Program_21c.py -- 

- Phase portrait Josephson junction limit 

cycle. 

Program_21d.py -- 

- Animated Josephson junction limit cycle. 
Program_21e.py -- 

- Pinched hysteresis of a memristor. 


Index 


absorptive nonlinearity 
action potential 
activation 

function 

level 

potential 
ADALINE network 
affine linear transformation 
age class 
Airy equation 
algebraicity of limit cycles 
All or None principle 
Alzheimer’s disease 
ampere 
Ampere’s law 
Anaconda 
Anaconda Python programs 
anemia 
angiogenesis 
angular frequency of the wave 
animation 

Spyder 
ants and termites 


aperiodic 

behavior 
append 
applying a damper 
arrhythmic 
Artificial Intelligence Group 
artificial neural networks 
ArtistAnimation 
assay for neuronal degradation 
associative memory 
asymptotic expansion 
asymptotically stable 

critical point 
asynchronous updating 
attractor 
attributes 
autocatalysis 
autonomous differential equation 
autonomous system 
auxiliary system approach 
average Lyapunov exponent 
ax.set title 
Axes3D(fig) 
axial flow compressors 
axon 
Baby computer 
backpropagation 

algorithm 
backward training 
ballistic propagation 
bandwidth 
Barnsley’s fern 
basin of attraction 
basis 
batch data 
Belousov-Zhabotinski reaction 
Bendixson’s criterion 
bias 
bifurcating limit cycles from a center 


bifurcation 
curve 
diagram 
at infinity 
point 
value 
bifurcation diagram 
CR resonator 
DDE 
field components 
Mackey-Glass 
Duffing equation 
Gaussian map 
Ikeda map 
Josephson junction 
limit cycles 
logistic map 
neuromodule 
periodically forced pendulum 
SFR resonator 
SNIC 
binarize 
binary half adder 
biology 
bipolar activation function 
bistability 
bistable 
cycle 
device 
neuromodule 
optical resonator 
region 
solution 
bistable region 
blit 
blowflies 
bluegill sunfish 
Boston housing data 
boundaries of periodic orbits 


box-counting dimension 
brain functions 
Briggs-Rauscher 
bursting 
butterfly effect 
BZ reaction 
canny edge detector 
canonical form 
Cantor 
multifractal 
set 
capacitance 
capacitor 
cardioid 
cardiology 
carrying capacity 
cavity ring (CR) resonator 
cavity round-trip time 
cell body 
center 
manifold 
theorem 
changing the system parameters 
chaologist 
chaos 
control 
synchronization 
chaos control 
OGY method 
periodic proportional pulses 
chaos game 
chaotic 
attractor 
dynamics 
phenomena 
chaotic attractor 
Hénon map 
neuromodule 
Sierpinski 


Chapman cycle 
characteristic 

equation 

exponent 

multiplier 
charge density 
chemical 

kinetics 

reaction 

signals 

substance 
chemical law of mass action 
Chua’s circuit 
circle map 
circular frequency of light 
classical symmetry argument 
classification of critical points 
climate change 
clipping problem 
clockwise bistable cycle 
clockwise hysteresis 
cluster 
cmap 
CMOS oscillators 
coarse Hélder exponent 
codimension-1 bifurcation 
codimension-2 bifurcation 
coexistence 
coexisting chaotic attractors 
col 
collect 
comb(k,s) 
common typing errors 
commutative ring 
competing species 
complete synchronization 
completely 

integrable 

reduced 
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complex elgenvalues 
complex iterative equation 
complex(x,y) 
compound interest 
computer algebra 
concentrations 
conditional Lyapunov exponents 
conductivity 
conformal mapping 
conservation of energy 
conservation of mass 
conservative 
contact rate 
content-addressable memory 
continuation lines 
continuous Hopfield model 
contour plot 
control curves 
control engineering 
control parameter 
control region 
controlling chaos 

Hénon map 

logistic map 
conversational agents 
convex closed curve 
convoluted surfaces 
coordinates of an image 
core area of the fiber 
corollary to Poincaré-Bendixson theorem 
correlation dimension 
coulomb 
counterclockwise hysteresis 
coupler 
critical point 

at infinity 
culling 

policy 
current 


dancitrr 


UTLISILY 
cusp 
cylindrical polar coordinates 
damping 
damping coefficient 
dangerous bifurcation 
Daphnia dentifera 
dashed curve 
data 
data mining 
databases 
DDE 
dde23 
ddeint 
def 
defibrillator 
defraction 
degenerate 
critical point 
node 
degree 
degree lexicographical order 
delay differential equation 
deleted neighborhood 
delta learning rule 
dendrites 
depolarization 
depolarize 
derivative of the Poincaré map test 
desired vector 
deterministic chaos 
deterministic system 
2 
dielectric 
difference equation 
differential amplifier 
diffusion limited aggregates (DLA) 
dimension 


direction 
fianld 


Lie1u 

vector 
discrete Fourier transform 
discrete Hopfield model 
dispersive nonlinearity 
displacement function 
distributive laws 
divergence test 
domain of stability 
double-coupler fiber ring resonator 
double Hopf bifurcation 
double-scroll attractor 
double-well potential 
D a 
driver system 
dsolve 
Duffing 

equation 

system 
Dulac’s criterion 
Dulac’s theorem 
Ec 
economic model 
economics 
edge detection 

Roberts 

Sobel 
eig 
eigenvector 
El Niño 
electric 

circuit 

displacement 

displacement vector 

field 

field strength 

flux density 
electromotive force (EMF) 
elementary steps 


elliptic integral 

EMF 

energy level 

enrichment of prey 

ENSO model 

Enthought Canopy 

environmental effects 

environmental model 

epidemic 

epilepsy 

epoch 

equilibrium point 

ergodicity 

error backpropagation rule 

error function 

erythrocytes 

Es 

Ey 

Euclidean dimension 

Euclid’s algorithm 

exact 

exact differential equation 

excitatory 

existence and uniqueness 
limit cycle 

existence theorem 

extinct 

Fabry-Perot 
interferometer 
resonator 

farad 

Faraday’s law 
of induction 

fast Fourier transform 

feedback 

feedback mechanism 

feedforward single layer network 

Feigenbaum constant 

Ferranti Mark 1 


FFT 
fiber parameters 
Fibonacci sequence 
field 
figsize 
fine focus 
first integral 
first iterative method 
first return map 
first-order difference equation 
fish population 
Fitzhugh-Nagumo 
equations 
oscillator 
system 
fixed point 
period m 
period N 
period one 
period two 
fixed size box-counting algorithm 
fixed weight box-counting algorithm 
flow 
focal values 
fold bifurcation 
for loop 
forced system 
forward rate constant 
fossil dating 
Fourier spectrum 
Fourier transform 
fractal 
attractor 
dimension 
Cantor set 
Koch curve 
Koch square 
Sierpinski triangle 
geometry 


structure 
fragmentation ratios 
f (a ) spectrum 
FuncAnimation 
Function 
function approximators 
fundamental memory 
fuzzy discs 
Gauss’s law 
electricity 
magnetism 
Gauss-Newton method 
Gaussian input pulse 
Gaussian map 
Gaussian pulse 
generalized delta rule 
generalized fractal dimensions 
generalized mixed Rayleigh Liénard equations 
generalized synchronization 
gestation period 
GitHub 
global bifurcation 
global warming 
globally asymptotically stable 
glucose in blood 
Gröbner bases 
gradient 
gradient vector 
graphene nano-ribbon 
graphic 
graphical method 
gray scale 
Green’s theorem 
Gross National Product (GNP) 
Guido van Rossum 
Hénon-Heiles Hamiltonian 
haematopoiesis 
Hamiltonian 
Hamiltonian systems 


ral 


with two degrees ot treedom 
handcrafted patterns 
hard bifurcation 
Hartman’s theorem 
harvesting 

policy 
Hausdorff dimension 
Hausdorff index 
Hausdorff-Besicovich dimension 
Heaviside function 
Hebb’s learning law 
Hebb’s postulate of learning 
help command 
Hénon map 
henry 
heteroclinic 

bifurcation 

orbit 

tangle 
heterogeneous 
hidden layer 
high pass filter 
Hilbert numbers 
Hints for programming 
history 
history function, DDEs 
Hodgkin-Huxley equations 
Holling-Tanner model 
homoclinic 

bifurcation 

loop 

orbit 

tangle 
homogeneous 
homogeneous differential equation 
Hopf 

bifurcation 

singularity 
Hopfield network 
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horseshoe dynamics 
host-parasite system 
human population 
hyperbolic 
attracting 
critical point 
fixed point 
iterated function system 
repelling 
stable limit cycle 
unstable limit cycle 
hyperpolarize 
hyperpolarized 
hysteresis 
curves 
Josephen junction 
IDE 
ideal 
IDLE 
IDLE Python programs 
if, elif, else 
Ikeda 
DDE 
map 
im 
image analysis 
image compression 
incident 
indentation level 
index 
inductance 
infected population 
infectives 
inflation unemployment model 
infodict 
information dimension 
inhibitory 
initial value problem 


innit wartar 


mupur veuws 
insect population 
instability 
instant physician 
integrable 
integrate and fire neuron 
Integrated Development Environment 
integrating factor 
intensity 
interacting species 
intermittency 
route to chaos 
invariant 
axes 
inverse discrete Fourier transform 
inverted Koch snowflake 
inverted Koch square 
inverted pendulum 
io.imsave 
isoclines 
isolated periodic solution 
isothermal chemical reaction 
iterated function system (IFS) 
iteration 
Jacobian 
Jacobian matrix 
Jaynes-Cummings model 
Jordan curve 
Josephson junction 
mathematical model 
Josephson junction (JJ) 
jth point of period i 
Julia set 
color 
KAM 
theorem 
tori 
kernel machines 
Kerr 
effect 


type 
kinetic energy 
Kirchhoff’s 

current law 

laws 

voltage law 
Koch 

curve 

snowflake 

square 
ladybirds and aphids 
lambdas 
laminarize 
Lang-Kobayashi equations 
Laplace transform 
large-amplitude limit cycle 

bifurcation 
laser 

model 
LaTeX 
law of mass action 
learning process 
learning rate 
least mean squared (LMS) algorithm 
legend 
Legendre transformation 
Leslie 

matrix 

model 
lexicographical order 
lie detector 
Liénard 

equation 

plane 

system 

large parameter 
local results 

theorem 

limit cycle 


hyperbolic 

neuron 

nonexistence 

3-D 
Lindstedt-Poincaré technique 
linear differential equation 
linear phase shift 
linear stability analysis 
linear transformation 
linearization 
linearized system 
Lipschitz 

condition 

continuous 
local bifurcation 
log-log plot 
logic gates 
logic operations 
logistic 

equation 

function 

growth 

map 
Lorenz 

attractor 

equations 
loss in the fiber 
Lotka-Volterra model 
low-gain saturation function 
low pass filter 
lowest common multiple 
Lyapunov 

quantity 

stability 
Lyapunov domain of stability 
Lyapunov exponent 

Lorenz system 
Lyapunov function 

Hopfield network 


Lyapunov quantities 
Lyapunov stability theorem 
lynx and snowshoe hares 
Mac OS 
Mackey-Glass model 
magnetic field vector 
magnetic flux 
magnetostrictive ribbon 
Mandelbrot 
Mandelbrot set 
manifold 
Maple 
math module 
Mathematica 
MATLAB 
MATLAB code to Python 
matplotlib 
maximal interval of existence 
Maxwell’s equations 
Maxwell-Bloch equations 
Maxwell-Debye equations 
McCulloch-Pitts neuron 
MEA 
mean 
infectivity period 
latency period 
mechanical oscillator 
DDE 
mechanical system 
Melnikov 
function 
integral 
memory devices 
memristance 
memristor 
mathematical model 
meshgrid 
meteorology 
method of multiple scales 


method of steepest descent 
method of steps 
mgrid 
micro-parasite—zooplankton—fish system 
minimal chaotic neuromodule 
minimal Gröbner basis 
mixed fundamental memories 
mixing 
modulo 
monomial 
ordering 
mortgage assessment 
motif 
mplot3d 
multi-electrode array 
multidegree 
multifractal 
formalism 
Hénon map 
Sierpiński triangle 
spectra 
multistability 
multistable 
murder 
muscle model 
mutual exclusion 
myimages 
mylein sheath 
national income 
negative 
limit set 
semiorbit 
negatively, invariant 
net reproduction rate 
network architecture 
neural network 
DDE 
neuristor 
neurodynamics 


neurological assay 
neuromodule 
neuron 

module 
neuron(s) 
neuronal model 
neurotransmitters 
Newton fractal 
Newton’s law of cooling 
Newton’s law of motion 
Newton’s method 
noise 
NOLM 

with feedback 
nonautonomous system 
nonconvex closed curve 
nondegenerate 

critical point 
nondeterministic chaos 
nondeterministic system 
nonexistence of limit cycles 
nonhyperbolic 

critical point 

fixed point 
nonlinear 

center 

optics 

phase shift 

refractive index coefficient 
nonlinearity 
nonperiodic behavior 
nonsimple canonical system 
normal form 
normalized eigenvector 
not robust 
notebook 
np.mgrid 
nullclines 
numerical solutions 


numpy 
occasional proportional feedback (OPF) 
ODE 
odeint 
OGY method 
ohm 
Ohm’s law 
optical 
bistability 
computer 
fiber 
fiber double ring 
memories 
oscillators 
resonator 
sensor 
optimal sustainable 
optogenetics 
orbit 
ordinary differential equation 
oscillation of a violin string 
oscillatory threshold logic 
output vector 
ozone production 
parasitic infection 
Parkinson’s disease 
partial differential equations 
partition function 
Pascal’s triangle 
passive circuit 
Peixoto’s theorem in the plane 
pendulum 
double 
perceptron 
perihelion 
period 
bubblings 
limit cycle 


undoublings 
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period-doubling bifurcations to chaos 
period-n cycle 
period-one behavior 
period-two 

behavior 
period-three behavior 
periodic 

behavior 

orbit 

windows 
periodicity 
permittivity of free space 
perturbation methods 
phase portrait 
phase shift 
physiology 
piecewise 
piecewise linear function 
pinched hysteresis 
pitchfork bifurcation 
pixels 
planar manifold 
plastics 
plt.axes 
Poincaré 

compactification 

map 

section 
Poincaré-Bendixson theorem 
Poisson brackets 
polar coordinates 
pole placement technique 
pollution 
polymer 
population 

of rabbits 
population model 
positive 


limit cat 


semiorbit 
positively, invariant 
potato man 
potential difference 
potential energy 
potential function 
pow(x,y) 
power 

law 

spectra 

of a waterwheel 
power-splitting ratio 
pprint 
Prandtl number 
preallocate 
predation 

rate 
predator-prey 

DDE 

models 

system 
probe vector 
propagation 
psychological profiling 
PyDDE 
pydelay 
Pyragas’s method 
Python 

based exam 

files download 
qth moment 
qualitative behavior 
qualitatively equivalent 
quasiperiodicity 
quasi-polynomials 
quasiperiodic 

route to chaos 
quasiperiodic forcing 
quiver 
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Rossler 

attractor 

system 
radioactive decay 
randint(a,b) 
random behavior 
Raspberry Pi 
rate constant 
rate-determining step 
Rational(1,2) 
rationally independent 
ravel 
Rayleigh number 
Rayleigh system 
re 
reaction rate equation 
real distinct eigenvalues 
recurrence relation 
recurrent neural network 
red blood cells 
red and grey squirrels 
reduced 
reduced Grébner basis 
reflected 
refractive index 
refractive nonlinearity 
refuge 
regionprops 
regulator poles 
relative permeabilities 
relative permittivities 
repeated real eigenvalues 
repolarization 
resistance 
resonance terms 
resonant 
response system 
restoring coefficient 
restoring force 


restrictions in programming 
return map 
reverse rate constant 
reversed fundamental memories 
RGB image 
rgb2gray 
ring 
ringing 
RLC circuit 
roach:fish population 
robust 
Rotating Wave Approximation (RWA) 
rsolve 
rubbers 
S-polynomial 
saddle point 
saddle-node bifurcation 
saddle-node on an invariant cycle bifurcation 
safe bifurcation 
save image 
savefig 
scaling 
scatter 
sea lions and penguins 
seasonal effects 
seasonality 
second iterative method 
second order linear difference equation 
second part of Hilbert’s sixteenth problem 
second-order differential equation 
secular term 
sedimentary rocks 
self-similar 
self-similar fractal 
self-similarity 
semistable 

critical point 

limit cycle 
sensitivity to initial conditions 


separable differential equation 
separation of variables 
separatrix 

cycle 
series solutions 
SFR 

resonator 
sharks and fish 
Sierpinski triangle 
sigmoid function 
signal processing 
simple canonical system 
simple nonlinear pendulum 
simply connected domain 
singlet 
singular node 
Smale horseshoe map 
Smale-Birkhoff theorem 
small perturbation 
small-amplitude limit cycle 
soft bifurcation 
solar system 
solution curves 
solve 
soma 
spatial vector 
spectrum of Lyapunov exponents 
speed of light 
spike train 
spin-glass states 
spirals 
spurious steady state 
SR flip-flop 
stability 

diagram 
stable 

critical point 

fixed point 

focus 


limit cycle 

manifold 

node 
staircases 
stationary point 
std 
steady state 
stem cell 
stiff system 
stiffness 
stochastic methods 
stock market analysis 
stoichiometric equations 
Stokes’s theorem 
strange attractor 
stretching and folding 
strictly dominant 
structurally 

stable 

unstable 
subcritical Hopf bifurcation 
subharmonic oscillations 
subplots 
summing junction 
superconductor 
supercritical Hopf bifurcation 
supervised learning 
surface plot 
susceptible population 
susceptibles 
sustainable 
switches 
symbols 
sympy 
synaptic 

cleft 

gap 

vesicles 

weights 


synchronization 
synchronization of chaos 
synchronous updating 
target vector 
targeting 
T(q) 
Taylor series expansion 
tent map 
3D plot 
three-dimensional system 
threshold 
logic 
value 
time series 
chaos detection 
plot 
Tinkerbell map 
Toda Hamiltonian 
topological dimension 
topologically equivalent 
torus 
total degree 
totally 
connected 
disconnected 
training 
trajectory 
transcritical bifurcation 
transfer function 
transient 
transmitted 
transversal 
transversely 
travelling salesman problem 
triangular pulse 
trigsimp 
trivial fixed point 
turbulence 
2D plot 
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two-neuron moaule 
uint8 
unconstrained optimization problem 
uncoupled 
uniform asymptotic expansion 
uniform harvesting 
unipolar activation function 
uniqueness theorem 
universality 
Unix 
unstable 
critical point 
fixed point 
focus 
limit cycle 
manifold 
node 
unsupervised learning 
vacuum 
vacuum tube oscillator 
value of homes in Boston 
van der Pol equation 
van der Pol system 
vector field 
plot 
velocity of light 
Verhulst’s equation 
virus, mobile phone 
viscosity 
viscous fingering 
volt 
voltage drop 
wave equations 
wave vector 
wavelength 
light 
Wie 
while loop 
Windows 
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wing rock 

WinPython 

Ws 

Wu 

X-ray spectroscopy 
XOR gate 

You Tube 

youngest class harvesting 
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